-- Logs begin at Fri 2022-07-15 13:20:04 UTC, end at Fri 2022-07-15 14:21:25 UTC. -- Jul 15 13:51:48.311680 dv-cinder-850002-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 13:51:48.319976 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 13:51:48 2022] *** Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: nodename: dv-cinder-850002-1-iscsi Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: machine: x86_64 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: clock source: unix Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: pcre jit disabled Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: detected number of CPU cores: 4 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: current working directory: / Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: detected binary path: /usr/bin/uwsgi-core Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: your processes number limit is 47680 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: your memory page size is 4096 bytes Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: detected max file descriptor number: 2048 Jul 15 13:51:48.323119 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: lock engine: pthread robust mutexes Jul 15 13:51:48.324041 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: thunder lock: enabled Jul 15 13:51:48.324041 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 13:51:48.324041 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 13:51:48.362514 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: Python main interpreter initialized at 0x5619008029c0 Jul 15 13:51:48.362514 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: python threads support enabled Jul 15 13:51:48.362514 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: your server socket listen backlog is limited to 100 connections Jul 15 13:51:48.362514 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: your mercy for graceful operations on workers is 90 seconds Jul 15 13:51:48.362862 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 13:51:48.362936 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: *** Operational MODE: preforking *** Jul 15 13:51:48.363175 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: *** uWSGI is running in multiple interpreter mode *** Jul 15 13:51:48.363175 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: spawned uWSGI master process (pid: 103132) Jul 15 13:51:48.363378 dv-cinder-850002-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 13:51:48.364779 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: spawned uWSGI worker 1 (pid: 103133, cores: 1) Jul 15 13:51:48.364779 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: spawned uWSGI worker 2 (pid: 103134, cores: 1) Jul 15 13:51:48.364779 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 13:51:49.027019 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 13:51:49.034973 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 13:51:50.129838 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 13:51:50.129838 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Jul 15 13:51:50.130602 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 13:51:50.130602 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Jul 15 13:51:50.139341 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 13:51:50.139341 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Jul 15 13:51:50.139782 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 13:51:50.139782 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Jul 15 13:51:52.650838 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 13:51:52.651439 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 13:51:52.651597 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 13:51:52.651959 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 13:51:52.652214 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 13:51:52.652625 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.652951 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.653271 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.653587 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.653911 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.654219 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.654535 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.654850 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.655172 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.655431 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.655740 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.656064 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850002-1-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.656404 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.656718 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.657023 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.657336 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.657637 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.657960 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.658261 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.658750 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.659200 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.659509 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.659818 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.660152 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.660363 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 13:51:52.660762 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.660856 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 13:51:52.660924 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.661100 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.661208 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 13:51:52.661405 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.661493 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 13:51:52.661725 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.661837 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 13:51:52.662038 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.662134 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.662434 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850002-1-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.662536 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.662747 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.662846 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663058 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663152 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663368 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663537 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663687 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.663823 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664010 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664100 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664332 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664456 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664697 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664794 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.664959 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665051 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665279 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665380 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665606 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850002-1-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665698 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.665919 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.666010 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.666771 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.666880 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667086 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667180 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667386 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667489 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667693 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667783 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.667999 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668094 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668316 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668443 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668643 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668864 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.668979 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669182 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669282 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669485 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669577 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669794 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.669885 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670108 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670205 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670425 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670521 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670675 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670763 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.670925 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671043 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671240 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671354 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671555 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671682 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671861 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.671994 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.672168 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.672428 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850002-1-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.672520 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.672737 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.672834 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673052 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673145 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673369 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673466 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673673 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673781 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.673977 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674096 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674291 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674409 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674601 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674733 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.674917 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675058 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675224 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675370 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675538 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675700 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.675927 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676031 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676176 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676332 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676504 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676695 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.676845 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677003 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677139 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677317 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677468 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677623 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677746 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.677950 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678062 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678258 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678374 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678567 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678669 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678823 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.678970 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679135 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679286 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679458 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679619 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679780 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.679922 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680108 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680196 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680364 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680510 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680641 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680771 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.680965 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.681086 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.681290 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.681378 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.681604 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.681697 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.682468 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.682579 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.682785 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.682887 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683098 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683185 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683401 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683493 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683706 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.683793 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684011 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684144 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684316 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684434 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684642 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684730 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.684946 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685035 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685249 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685348 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685549 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685637 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.685950 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686178 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686278 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686482 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686577 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686786 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.686882 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687089 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687195 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687394 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687482 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687710 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.687802 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.688015 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.688115 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.688331 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.688675 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.688904 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689001 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689225 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689330 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689539 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689640 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689852 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.689952 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690332 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690474 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690576 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690772 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.690867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691036 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691123 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691343 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691428 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691652 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691738 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.691953 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692047 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692253 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692342 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692578 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692675 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692879 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.692973 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693179 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693265 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693476 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693562 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693776 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.693864 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694071 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694172 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694378 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694480 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694687 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694780 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.694991 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695077 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695295 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695395 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695595 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695688 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695900 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.695992 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.696220 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.696315 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.696564 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.696664 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.696875 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.696962 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.697183 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.697278 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.697518 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.697616 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.697833 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.697920 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.698156 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.698251 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.698465 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.698550 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.698771 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.698865 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.699092 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.699190 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.699396 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.699489 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.699704 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.699791 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.700014 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.700102 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.700323 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.700444 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.700660 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.700750 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.700984 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.701072 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.701286 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.701373 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.701596 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.701692 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.701911 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.702000 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.702218 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.702304 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.702524 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.702611 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.702831 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.702921 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.703138 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.703235 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.703443 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.703538 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.703748 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.703835 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.704055 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.704143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.704362 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.704545 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.704688 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.704801 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.705008 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.705122 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.705362 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.705476 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.705640 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.705739 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.705949 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.706057 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.706255 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.706352 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.706577 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 13:51:52.706664 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.706918 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707005 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707230 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707336 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707537 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707625 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707848 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.707935 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708158 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708254 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708495 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708587 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708806 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.708893 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709137 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709227 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709446 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709541 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709759 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.709856 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710070 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710169 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710382 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710469 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710690 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.710785 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711000 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711102 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711308 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711395 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711608 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711697 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711909 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.711999 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712211 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712353 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712541 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712657 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712842 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.712931 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.713700 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.713792 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714024 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714123 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714329 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714424 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714655 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714742 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.714958 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715053 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715264 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715351 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715568 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715656 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715874 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.715973 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716174 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716260 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716504 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716606 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716812 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.716907 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717112 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717215 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717429 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717528 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717732 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.717830 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718034 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718121 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718354 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718663 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718751 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.718962 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719049 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719272 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719360 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719578 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719673 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719885 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.719973 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720197 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720293 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720527 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720618 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720850 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.720939 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721159 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721258 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721468 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721565 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721799 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.721887 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722112 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722207 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722415 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722502 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722720 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.722807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723029 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723128 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723337 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723431 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723649 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723737 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.723956 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.724044 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.724282 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.724641 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.724876 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.724974 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725178 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725274 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725484 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725578 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725783 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.725871 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726083 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726172 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726382 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726469 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726680 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726767 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.726979 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727073 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727296 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727422 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727602 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727697 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727903 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.727998 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.728202 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.728296 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.728524 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.728628 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.729417 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.729513 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.729750 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.729847 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730062 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730158 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730374 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730462 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730696 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.730782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731013 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731110 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731331 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731418 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731651 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731738 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.731958 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732051 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732270 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732363 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732606 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732703 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.732918 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733006 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733235 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733328 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733544 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733642 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733862 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.733950 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734168 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734256 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734488 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734575 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734795 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.734890 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735109 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735195 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735408 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735496 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735718 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.735805 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736030 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736116 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736341 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736502 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736681 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736769 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.736990 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737077 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737297 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737393 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737603 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737696 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737906 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.737999 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738214 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738309 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738521 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738607 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738835 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.738922 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739141 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739239 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739449 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739536 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739756 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.739849 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740060 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740157 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740379 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740494 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740706 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.740794 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741021 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741109 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741325 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741429 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741630 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741718 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.741953 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742101 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742280 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742368 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742586 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742682 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742896 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.742984 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743208 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743293 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743513 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743607 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743818 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.743904 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744127 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744220 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744495 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744603 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744802 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.744928 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745110 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745198 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745421 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745521 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745728 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.745817 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746031 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746117 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746330 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746425 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746640 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746728 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.746943 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747030 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747245 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747341 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747546 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747676 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747856 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.747950 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748172 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748260 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748506 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748598 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748832 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.748935 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749151 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749239 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749451 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749538 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749751 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.749845 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750068 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750156 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750371 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750457 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750672 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750758 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.750972 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751060 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751272 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751374 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751601 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751699 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751902 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.751988 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752202 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752289 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752558 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752665 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752871 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.752957 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753178 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753265 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753491 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753587 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753798 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.753886 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754103 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754191 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754413 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754507 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754721 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.754808 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755026 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755120 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755332 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755419 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755640 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755725 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.755946 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756033 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756256 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756356 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756588 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756677 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756894 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.756981 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757201 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757290 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757509 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757597 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757808 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.757895 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758111 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758198 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758421 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758506 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758741 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.758999 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759094 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759329 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759416 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759641 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759728 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.759991 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760079 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760587 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760689 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760758 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760823 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.760950 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761039 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761257 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761356 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761567 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761653 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761874 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.761973 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762220 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762319 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762530 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762617 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762831 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.762926 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763139 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763226 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763442 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763529 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763742 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.763838 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764043 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764134 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764349 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764456 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764681 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764776 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.764982 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765069 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765283 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765371 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765584 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765672 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765891 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.765986 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766189 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766284 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766497 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766585 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766796 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.766890 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767112 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767199 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767417 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767534 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767715 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.767800 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768014 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768184 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768315 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768473 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768679 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768819 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.768986 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.769085 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.769320 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.769594 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.769680 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.769930 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770024 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770253 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770341 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770551 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770650 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770872 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.770959 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771173 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771262 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771472 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771558 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771771 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.771867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772077 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772164 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772379 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772500 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772698 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.772786 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773096 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773226 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773406 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773604 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773720 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.773920 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774021 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774227 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774623 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774721 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.774935 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.775032 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.775242 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.775382 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776095 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776239 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776418 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776581 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776734 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.776887 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777055 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777190 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777366 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777498 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777682 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777804 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.777992 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.778105 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.778411 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.778660 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.778753 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.778988 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779089 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779298 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779395 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779599 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779685 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.779900 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780000 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780205 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780301 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780531 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780621 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780835 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.780924 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781246 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781551 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781638 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781864 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.781993 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782175 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782296 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782506 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782593 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782816 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.782902 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.783126 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.783430 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.783518 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.783745 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784007 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784102 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784353 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784639 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784739 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.784995 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.785234 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.785331 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.785607 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.785813 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.785901 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.786216 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.786396 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.786526 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.786848 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.786977 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.787163 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.787471 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.787559 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.787778 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788042 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788129 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788365 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788473 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788703 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.788801 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789019 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789116 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789326 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789413 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789638 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789725 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.789944 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790031 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790255 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790342 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790564 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790652 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790871 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.790957 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.791225 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.791807 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792025 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792113 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792358 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792522 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792689 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792776 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.792999 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793094 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793309 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793398 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793622 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793718 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.793931 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794064 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794239 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794326 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794550 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794645 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794860 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.794945 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795162 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795258 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795474 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795568 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.795868 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.796089 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.796176 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.796406 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.796666 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.796756 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797064 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797163 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797374 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797538 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797687 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.797854 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.798050 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.798324 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.798549 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.798654 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.798738 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799106 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799309 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799309 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799521 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799681 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799805 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.799991 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.800261 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.800472 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.800705 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.800805 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.801060 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.801156 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.801376 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.801638 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.801747 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802190 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802288 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802442 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802532 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.802987 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.803133 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.803370 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.803457 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.803790 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.803962 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.804125 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.804236 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.804508 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.804669 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.804819 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805122 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805224 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805501 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805673 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805823 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.805910 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.806155 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.806312 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.806611 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.806774 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.806965 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.807172 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.807321 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.807590 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.807719 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.807916 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.808003 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.808289 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.808471 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.808701 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.808846 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809044 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809192 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809281 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809640 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809780 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.809978 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.810066 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.810338 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.810425 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.810685 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.810774 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811009 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811185 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811351 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811513 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811646 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.811948 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812038 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812418 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812577 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812684 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812846 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.812997 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.813312 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.813403 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.813664 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.813779 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.813985 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.814082 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.814445 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.814534 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.814758 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.814854 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.815080 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.815284 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.815510 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.815641 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.815876 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.816034 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.816190 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.816515 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.816610 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.816926 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817030 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817250 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817339 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817592 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.817921 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818066 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818231 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818522 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818608 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818893 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.818981 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.819253 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.819378 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.819608 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.819847 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.819989 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.820257 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.820473 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.820648 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.820750 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821046 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821222 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821337 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821484 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821740 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.821941 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.822186 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.822314 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.822439 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.822735 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.822824 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.823155 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.823243 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.823461 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.823620 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.823783 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.824064 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.824188 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.824495 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.824601 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.824927 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825028 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825255 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825342 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825582 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825756 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.825936 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.826199 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.826287 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.826636 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.826722 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.826943 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827076 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827298 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827499 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827665 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827889 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.827976 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.828324 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.828437 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.828706 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.828793 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.829032 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.829207 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.829362 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.829745 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.829848 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.830018 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.830374 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.830468 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.830717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.830814 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.831026 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.831222 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.831333 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.831733 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.831829 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.832088 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.832174 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.832464 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.832690 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.832814 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.833107 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.833216 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.833505 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.833601 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.833911 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834041 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834201 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834331 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834589 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834783 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.834950 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.835171 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.835304 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.835601 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.835690 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.835946 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.836071 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.836256 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.836555 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.836645 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.836978 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837065 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837285 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837432 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837631 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837873 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.837968 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.838756 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.838845 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.839143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.839244 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.839500 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.839629 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.839786 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840141 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840231 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840472 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840563 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840838 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.840954 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.841147 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.841300 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.841451 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.841757 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.841844 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842167 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842262 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842501 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842603 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842860 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.842969 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.843218 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.843319 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.843549 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.843776 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.843899 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.844103 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.844221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.844659 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.844749 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845024 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845123 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845364 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845505 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845705 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.845859 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.846048 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.846187 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.846402 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.846609 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.846724 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847053 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847139 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847415 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847572 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847773 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.847907 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.848101 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.848372 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.848796 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.848910 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.849101 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.849274 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.849705 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.849869 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.850017 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.850299 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.850399 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.850697 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.850792 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851016 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851153 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851363 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851505 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851674 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.851919 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.852015 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.852277 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.852369 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.852690 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.852790 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.853029 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.853245 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.853397 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.853734 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.854389 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.854563 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.854715 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855017 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855186 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855398 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855572 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855754 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.855910 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.856112 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.856337 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.856494 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.856802 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.856901 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.857127 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.857224 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.857514 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.857601 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.857875 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858026 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858194 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858348 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858511 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858763 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.858890 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859191 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859293 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859544 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859633 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859862 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.859969 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.860218 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.860315 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.860554 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.860693 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.860918 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861028 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861254 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861367 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861573 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861789 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.861890 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.862228 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.862366 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.862576 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.862688 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863120 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863227 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863506 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863681 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863848 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.863959 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.864172 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.864281 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.864561 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.864734 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.864946 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.865070 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.865245 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.865500 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.865588 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.865932 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866038 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866273 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866468 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866629 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866820 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.866934 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.867277 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.867390 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.867635 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.867744 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.867988 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.868130 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.868318 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.868599 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.868754 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.868918 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.869076 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.869462 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.869579 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.869802 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.869904 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.870219 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.870358 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.870569 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.870689 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.870953 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.871195 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.871312 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.871536 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.871669 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.871975 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.872279 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.872374 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.872696 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.872808 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873022 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873160 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873338 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873548 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873681 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.873979 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874075 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874312 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874426 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874645 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874852 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.874988 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.875287 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.875381 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.875635 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.875731 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876012 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876168 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876296 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876440 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876666 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.876889 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.877015 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.877297 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.877411 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.877690 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.877851 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.878041 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.878237 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.878347 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.878670 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.878789 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879022 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879166 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879372 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879508 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879685 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.879935 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.880038 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.880338 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.880448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.880705 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.880859 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.881036 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.881298 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.881436 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.881731 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.881829 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.882102 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.882222 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.882470 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.882568 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.882826 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883073 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883174 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883409 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883500 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883784 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.883873 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.884138 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.884277 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.884551 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.884662 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.884884 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.885028 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.885474 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.885566 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.885850 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.885958 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.886209 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.886298 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.886549 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.886706 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.886900 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887046 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887209 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887376 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887517 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887706 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.887823 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888036 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888146 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888489 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888613 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888802 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.888938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889111 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889279 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889426 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889612 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889733 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.889945 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890032 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890272 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890386 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890602 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890719 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.890917 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891018 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891223 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891325 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891530 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891620 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891837 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.891947 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892140 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892230 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892473 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892567 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892800 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.892901 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893117 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893215 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893430 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893518 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893741 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.893829 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894057 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894153 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894367 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894593 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894682 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.894949 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895076 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895259 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895354 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895574 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895663 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895899 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.895997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.896211 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.896300 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.896536 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.896626 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.896947 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897118 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897260 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897347 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897572 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897658 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897889 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.897984 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898195 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898282 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898501 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898594 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898814 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.898911 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899127 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899221 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899442 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899531 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899747 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.899835 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.900057 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.900143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.900376 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901098 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901249 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901385 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901563 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901659 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.901951 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902167 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902256 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902470 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902575 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902777 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.902874 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903084 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903171 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903390 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903478 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903692 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903788 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.903991 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904080 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904297 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904411 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904623 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904725 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.904923 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905012 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905223 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905311 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905525 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905622 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905839 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.905933 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906141 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906240 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906478 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906569 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.906870 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907084 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907172 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907384 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907473 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907683 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907771 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.907989 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908084 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908288 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908414 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908612 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908712 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.908914 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909009 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909213 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909302 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909510 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909802 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.909897 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910144 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910233 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910451 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910537 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910766 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.910853 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911074 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911170 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911393 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911489 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911698 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.911787 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912014 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912103 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912330 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912437 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912671 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912765 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.912977 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913067 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913296 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913383 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913604 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913699 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.913913 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914001 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914223 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914310 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914528 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914626 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914832 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.914928 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915137 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915225 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915544 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915760 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.915848 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.916061 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.916192 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.916939 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917030 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917263 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917352 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917589 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917677 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917903 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.917993 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918212 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918303 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918537 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918624 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918847 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.918936 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919156 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919244 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919463 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919605 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919774 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.919869 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920081 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920175 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920414 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920518 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920725 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.920814 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921037 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921132 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921351 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921662 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.921776 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922043 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922130 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922372 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922472 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922682 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.922770 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923003 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923091 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923326 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923414 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923652 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923741 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.923965 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924054 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924287 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924375 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924628 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924728 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.924951 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925038 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925287 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925412 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925617 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925710 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.925896 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 13:51:52.925993 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.926240 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.926549 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.926856 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.927168 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.927490 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.927805 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.928110 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.928442 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.928748 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.929054 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.929360 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.929665 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.929975 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.930285 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.930588 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.930894 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.931196 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.931500 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.931829 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.932137 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.932469 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.932779 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.933087 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.933392 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.933698 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.934001 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.934337 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.934672 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.934988 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.935311 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.935625 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.935947 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.936257 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.936609 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.936934 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.937255 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.937566 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.937902 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.938215 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.938544 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.938849 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.939162 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.939474 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.939789 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.940117 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.940466 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.940781 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.941109 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.941427 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.941752 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.942072 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.942388 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.942719 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.943033 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.943348 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.943660 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.943977 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.944291 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.944630 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.944945 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.945259 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.945577 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.945893 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.946221 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.946547 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.946858 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.947184 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.947538 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.947894 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.948210 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.948583 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.948915 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.949233 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.949548 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.949858 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 13:51:52.950104 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 13:51:52.987554 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Registered counter for database nova_api Jul 15 13:51:53.012599 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Registered counter for database nova_api Jul 15 13:51:53.102062 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.108884 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.124931 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.131247 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.165342 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.context [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9aab78-04cd-4061-be8a-70434796d300(cell1) {{(pid=103134) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 13:51:53.169347 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:51:53.170915 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:51:53.171710 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:51:53.173860 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:51:53.175795 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Registered counter for database nova_cell0 Jul 15 13:51:53.179663 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Registered counter for database nova_cell1 Jul 15 13:51:53.187603 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.188256 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.context [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9aab78-04cd-4061-be8a-70434796d300(cell1) {{(pid=103133) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 13:51:53.190112 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.192297 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:51:53.193860 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.193968 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:51:53.194738 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:51:53.196897 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:51:53.199432 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Registered counter for database nova_cell0 Jul 15 13:51:53.203319 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Registered counter for database nova_cell1 Jul 15 13:51:53.210679 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.212852 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.218399 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.220872 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.335055 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.345907 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Registered counter for database nova_cell0 Jul 15 13:51:53.353031 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.357347 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.369804 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Registered counter for database nova_cell0 Jul 15 13:51:53.378612 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 13:51:53.384560 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 13:51:53.692445 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 13:51:53.699776 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 13:51:53.700959 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 13:51:53.708257 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 13:51:54.041647 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 13:51:54.047454 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 13:51:54.052758 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619008029c0 pid: 103134 (default app) Jul 15 13:51:54.054808 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:51:54.055988 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jul 15 13:51:54.056408 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Jul 15 13:51:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:51:54.059297 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 13:51:54.065437 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-d07d5471-c4ce-4cdb-9606-2993c4833e1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 13:51:54.070580 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619008029c0 pid: 103133 (default app) Jul 15 13:53:14.443408 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:14.445163 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Jul 15 13:53:14.445828 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:14.464170 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:14.465804 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:14.467075 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell1:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:14.468106 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:15.403015 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-d15335be-a3e4-4f08-a572-7c046c83d21a admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:15.437668 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-d15335be-a3e4-4f08-a572-7c046c83d21a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.983190 Jul 15 13:53:15.438474 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jul 15 13:53:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:17.804366 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:17.805516 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-154a728d-be40-4ced-b378-fcf1c93bc927 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 15 13:53:17.805919 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:18.401329 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ff49c512-d503-4702-b638-dcdd8cfcad7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "ram": 256}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:18.443537 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:53:18.443537 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Jul 15 13:53:18.485676 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-ff49c512-d503-4702-b638-dcdd8cfcad7f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.672217 Jul 15 13:53:18.493767 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 13:53:18.504004 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:18.504940 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:18.505672 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell1:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:18.506787 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:18.749416 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a445c971-f0f7-45bf-ad0c-bf61d0a3bf0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:18.752086 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:53:18.752086 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:53:18.825088 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a445c971-f0f7-45bf-ad0c-bf61d0a3bf0e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.327416 Jul 15 13:53:18.825766 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jul 15 13:53:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:21.348490 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ff49c512-d503-4702-b638-dcdd8cfcad7f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:21.350157 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-ff49c512-d503-4702-b638-dcdd8cfcad7f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002440 Jul 15 13:53:21.351560 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:22.200910 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ef1134af-18e4-4ac8-b909-fa2b913a3384 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "disk": 5, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:22.218981 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:53:22.218981 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:53:22.242586 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ef1134af-18e4-4ac8-b909-fa2b913a3384 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.883656 Jul 15 13:53:22.244043 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:22.255925 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-7a48ebe1-c7f2-40b2-93ea-0f0b364824cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:22.257721 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:53:22.257721 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Jul 15 13:53:22.293463 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-7a48ebe1-c7f2-40b2-93ea-0f0b364824cf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040984 Jul 15 13:53:22.294434 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jul 15 13:53:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 13:53:24.554269 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ef1134af-18e4-4ac8-b909-fa2b913a3384 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:24.556101 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ef1134af-18e4-4ac8-b909-fa2b913a3384 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 15 13:53:24.556581 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:25.072155 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-db68bb45-5b1b-464c-8afa-7782c94520f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:25.091260 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-db68bb45-5b1b-464c-8afa-7782c94520f7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.527946 Jul 15 13:53:25.091823 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:25.104665 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-e6369035-94f7-4ffd-9375-0ab31f876bd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:25.127713 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-e6369035-94f7-4ffd-9375-0ab31f876bd6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027596 Jul 15 13:53:25.128295 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jul 15 13:53:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 13:53:27.383137 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-db68bb45-5b1b-464c-8afa-7782c94520f7 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:27.384290 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-db68bb45-5b1b-464c-8afa-7782c94520f7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jul 15 13:53:27.384728 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:27.891628 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-00177f00-417f-450e-b161-e1b0d3fc1404 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "disk": 10}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:27.910130 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-00177f00-417f-450e-b161-e1b0d3fc1404 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519320 Jul 15 13:53:27.910708 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:27.922774 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-dde5c303-f097-4c37-b846-56d6cd0c6e26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:27.947628 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-dde5c303-f097-4c37-b846-56d6cd0c6e26 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028537 Jul 15 13:53:27.948211 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jul 15 13:53:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 13:53:30.227977 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-00177f00-417f-450e-b161-e1b0d3fc1404 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:30.229134 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-00177f00-417f-450e-b161-e1b0d3fc1404 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Jul 15 13:53:30.229559 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:30.734894 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:30.755279 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519213 Jul 15 13:53:30.763524 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:30.768498 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-56101d3a-861f-4628-9e29-dc98f784cc11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:30.793039 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-56101d3a-861f-4628-9e29-dc98f784cc11 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028130 Jul 15 13:53:30.793874 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jul 15 13:53:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:33.095434 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:33.096888 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Jul 15 13:53:33.097265 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:33.703966 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-08e217a4-5e76-4fd8-a594-ec710f997d18 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:33.733181 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-08e217a4-5e76-4fd8-a594-ec710f997d18 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.628541 Jul 15 13:53:33.733838 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jul 15 13:53:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 13:53:36.078971 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:36.080331 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-273dc1df-fe80-4858-b449-feb0c37c0150 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jul 15 13:53:36.088557 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:36.676491 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-b9dafadb-c5f9-4a6f-a15b-ae8c66d993dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:36.698595 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-b9dafadb-c5f9-4a6f-a15b-ae8c66d993dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.609075 Jul 15 13:53:36.699171 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:36.712114 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-86c0a7dc-f0d2-4d03-8f6d-3294e734d947 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:36.739137 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-86c0a7dc-f0d2-4d03-8f6d-3294e734d947 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031327 Jul 15 13:53:36.739933 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jul 15 13:53:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:39.063345 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-b9dafadb-c5f9-4a6f-a15b-ae8c66d993dc admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:39.064427 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-b9dafadb-c5f9-4a6f-a15b-ae8c66d993dc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 15 13:53:39.064853 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:39.628857 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-b303954b-8b9c-49b7-a6d6-263d4c4f35b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:39.647389 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-b303954b-8b9c-49b7-a6d6-263d4c4f35b6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.574327 Jul 15 13:53:39.647953 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:39.660672 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-e6eea070-1753-4616-b806-7dc191514a44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:39.688541 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-e6eea070-1753-4616-b806-7dc191514a44 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031141 Jul 15 13:53:39.690435 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jul 15 13:53:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:42.053411 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-b303954b-8b9c-49b7-a6d6-263d4c4f35b6 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:42.054541 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-b303954b-8b9c-49b7-a6d6-263d4c4f35b6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 15 13:53:42.054981 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:42.597160 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ba23e190-c6fe-4460-ae43-34dad7085a96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:42.626922 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ba23e190-c6fe-4460-ae43-34dad7085a96 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.565684 Jul 15 13:53:42.627619 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:42.641282 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9cb1e214-e3e5-433d-b2de-bc656ef8bb99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:42.672856 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9cb1e214-e3e5-433d-b2de-bc656ef8bb99 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036294 Jul 15 13:53:42.688432 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jul 15 13:53:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:45.004686 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ba23e190-c6fe-4460-ae43-34dad7085a96 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:45.005885 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ba23e190-c6fe-4460-ae43-34dad7085a96 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jul 15 13:53:45.006381 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:45.499343 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-878c82e2-2c90-4c86-96ee-dfc6d1972377 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "vcpus": 4, "disk": 80}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:45.504409 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:53:45.521763 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-878c82e2-2c90-4c86-96ee-dfc6d1972377 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.507843 Jul 15 13:53:45.522641 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:53:45.534676 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-771a95a9-586d-41b8-ab13-7a40e8ea3b9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:45.562848 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-771a95a9-586d-41b8-ab13-7a40e8ea3b9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031773 Jul 15 13:53:45.563926 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jul 15 13:53:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:53:47.994427 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-878c82e2-2c90-4c86-96ee-dfc6d1972377 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:53:47.998653 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-878c82e2-2c90-4c86-96ee-dfc6d1972377 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004513 Jul 15 13:53:47.999489 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:53:48.679153 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "disk": 160, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:48.700709 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.694875 Jul 15 13:53:48.708665 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jul 15 13:53:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 13:53:48.714101 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-699b9bba-2dc8-4c17-af8d-0909b5a4df8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:53:48.743755 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-699b9bba-2dc8-4c17-af8d-0909b5a4df8a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032795 Jul 15 13:53:48.744503 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jul 15 13:53:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:54:07.971651 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:07.972695 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 15 13:54:07.973096 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:07.987691 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:54:08.406548 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-07dfaf82-ef5f-49ad-8fc5-65778b94ceec admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:08.424274 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-07dfaf82-ef5f-49ad-8fc5-65778b94ceec admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440961 Jul 15 13:54:08.424775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jul 15 13:54:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 13:54:09.534005 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:09.535013 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-3ce82ea1-12eb-4a03-9713-ff41660e007b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 15 13:54:09.535412 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 13:54:10.111821 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f02dc07-d14a-4b85-9176-0aa814ce7287 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:10.120931 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-9f02dc07-d14a-4b85-9176-0aa814ce7287 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f02dc07-d14a-4b85-9176-0aa814ce7287 admin admin] Request method failure captured: Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Host: 10.222.0.16 Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi0XGBL0jt7GbwrZ6OLuLlCi3YzeyuBSthPBvXt81KaAlTSSLqhj-hPAPOGcRdrWAbdiXjb_DqtbGa2iIicf5EvKP8iH1Dtx-0dKB3kJ-9MnDDbB15EauBMbJfuZai6qkl1SYzngwO54HZc__g8FOIm4aaUPcTN5GyTnnGJJRweyLBpDo Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Jul 15 13:54:10.127140 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User: admin Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: method: > Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: exception: Flavor 42 could not be found. Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: action_args: {'id': '42'} Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:10.128867 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:10.129938 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.131321 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f02dc07-d14a-4b85-9176-0aa814ce7287 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:10.133241 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9f02dc07-d14a-4b85-9176-0aa814ce7287 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.452021 Jul 15 13:54:10.133241 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jul 15 13:54:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 15 13:54:10.147242 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-feca09d3-a06d-4783-91a7-473390a619e1 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:10.152120 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:54:10.187387 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-feca09d3-a06d-4783-91a7-473390a619e1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.046669 Jul 15 13:54:10.188448 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:54:10.201150 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f1df2487-9d93-4dce-b721-3285366e7e1e admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:10.223193 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f1df2487-9d93-4dce-b721-3285366e7e1e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025612 Jul 15 13:54:10.223703 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 13:54:10.235213 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-09cfabce-cd16-403f-8ebf-6d346a95a5d2 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:10.242604 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-09cfabce-cd16-403f-8ebf-6d346a95a5d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-09cfabce-cd16-403f-8ebf-6d346a95a5d2 admin admin] Request method failure captured: Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept: application/json Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Host: 10.222.0.16 Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi0XGBL0jt7GbwrZ6OLuLlCi3YzeyuBSthPBvXt81KaAlTSSLqhj-hPAPOGcRdrWAbdiXjb_DqtbGa2iIicf5EvKP8iH1Dtx-0dKB3kJ-9MnDDbB15EauBMbJfuZai6qkl1SYzngwO54HZc__g8FOIm4aaUPcTN5GyTnnGJJRweyLBpDo Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Jul 15 13:54:10.246515 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User: admin Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: method: > Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: exception: Flavor 42 could not be found. Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: action_args: {'id': '42'} Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:10.249275 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:10.250863 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:10.252717 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-09cfabce-cd16-403f-8ebf-6d346a95a5d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:10.254926 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-09cfabce-cd16-403f-8ebf-6d346a95a5d2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016898 Jul 15 13:54:10.254926 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jul 15 13:54:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 13:54:11.274688 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f1df2487-9d93-4dce-b721-3285366e7e1e admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:11.275711 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f1df2487-9d93-4dce-b721-3285366e7e1e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 15 13:54:11.276108 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:11.834236 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-36f99540-540c-453a-86c3-59ae23a339f7 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:11.839832 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-36f99540-540c-453a-86c3-59ae23a339f7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-36f99540-540c-453a-86c3-59ae23a339f7 admin admin] Request method failure captured: Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept: application/json Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Host: 10.222.0.16 Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi0XGDZ6Xg99hsVxfVJcyTm6x2q8kokW8RV3b30mviLzR52uaea4hqboVLOrYRoXboADt3bmCHGjZcNXrGOcxtAaTkW4C02M-Ynpp_-6M3EINJ5zGwD6C7HeqAp6L3kRFUq70rkLom4aA8CXbRn-1y3I8xMhOY7pRiwXsJS1gCQPwn1Kw Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Jul 15 13:54:11.841432 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User: admin Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: method: > Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: exception: Flavor 84 could not be found. Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: action_args: {'id': '84'} Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:11.843782 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:11.845143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-36f99540-540c-453a-86c3-59ae23a339f7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:11.849380 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-36f99540-540c-453a-86c3-59ae23a339f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.424759 Jul 15 13:54:11.849380 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jul 15 13:54:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 13:54:11.853673 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-1b1c2caf-4a96-41b0-b52a-6834a3aef9a0 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:11.868132 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-1b1c2caf-4a96-41b0-b52a-6834a3aef9a0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018791 Jul 15 13:54:11.868729 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:54:11.878622 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c643e0b3-d2ee-403a-8051-6a7e0cb7fa2e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:11.892734 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c643e0b3-d2ee-403a-8051-6a7e0cb7fa2e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017555 Jul 15 13:54:11.893309 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:54:11.903568 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9a523516-22c2-417f-8b31-527d07dbfdf4 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:11.909253 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-9a523516-22c2-417f-8b31-527d07dbfdf4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9a523516-22c2-417f-8b31-527d07dbfdf4 admin admin] Request method failure captured: Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Host: 10.222.0.16 Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi0XGDZ6Xg99hsVxfVJcyTm6x2q8kokW8RV3b30mviLzR52uaea4hqboVLOrYRoXboADt3bmCHGjZcNXrGOcxtAaTkW4C02M-Ynpp_-6M3EINJ5zGwD6C7HeqAp6L3kRFUq70rkLom4aA8CXbRn-1y3I8xMhOY7pRiwXsJS1gCQPwn1Kw Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Jul 15 13:54:11.910775 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User: admin Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: method: > Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: exception: Flavor 84 could not be found. Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: action_args: {'id': '84'} Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:11.912448 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:11.914450 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:11.916686 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9a523516-22c2-417f-8b31-527d07dbfdf4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:11.918561 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9a523516-22c2-417f-8b31-527d07dbfdf4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012268 Jul 15 13:54:11.918561 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jul 15 13:54:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 13:54:12.920231 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c643e0b3-d2ee-403a-8051-6a7e0cb7fa2e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:12.921302 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c643e0b3-d2ee-403a-8051-6a7e0cb7fa2e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 15 13:54:12.921699 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:13.493242 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f4aaa732-7b21-45a8-9cf5-3107a12c6e76 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:13.499165 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-f4aaa732-7b21-45a8-9cf5-3107a12c6e76 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f4aaa732-7b21-45a8-9cf5-3107a12c6e76 admin admin] Request method failure captured: Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Host: 10.222.0.16 Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi0XGEILnktjOozTRfxQoXXvetECSCGsO90WMV-RbHBTq-YHC5c74S6RcBrodwKHJ8QgcPR6qrOaNx-T_EwIXcRPhVgFO9UVV4vYr9cjU7kiZf8x7a3aaoFQAsIW_3YETq2viisnz3zv7O7RuOhCSvbIrpzEZGs_KAKuktUkTXt7lJGxI Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Jul 15 13:54:13.500713 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User: admin Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: method: > Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: exception: Flavor 451 could not be found. Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: action_args: {'id': '451'} Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:13.502357 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:13.503419 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.504997 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f4aaa732-7b21-45a8-9cf5-3107a12c6e76 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:13.506376 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f4aaa732-7b21-45a8-9cf5-3107a12c6e76 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.441666 Jul 15 13:54:13.506376 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:54:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 13:54:13.511927 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ab8e5d0d-7b28-4972-b391-dd85207c03a5 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:13.525576 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ab8e5d0d-7b28-4972-b391-dd85207c03a5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017306 Jul 15 13:54:13.526134 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:54:13.535742 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:13.550178 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017900 Jul 15 13:54:13.550742 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jul 15 13:54:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:54:13.560951 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f0db93ee-f8c5-4ef6-a064-f513b017e23f admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:13.566315 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-f0db93ee-f8c5-4ef6-a064-f513b017e23f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f0db93ee-f8c5-4ef6-a064-f513b017e23f admin admin] Request method failure captured: Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept: application/json Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Host: 10.222.0.16 Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi0XGEILnktjOozTRfxQoXXvetECSCGsO90WMV-RbHBTq-YHC5c74S6RcBrodwKHJ8QgcPR6qrOaNx-T_EwIXcRPhVgFO9UVV4vYr9cjU7kiZf8x7a3aaoFQAsIW_3YETq2viisnz3zv7O7RuOhCSvbIrpzEZGs_KAKuktUkTXt7lJGxI Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Jul 15 13:54:13.567807 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8618b94bef7144e799c6d51bb1ef841f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8618b94bef7144e799c6d51bb1ef841f"}]}] Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 8618b94bef7144e799c6d51bb1ef841f Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User: admin Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Id: 0802dbaa2668431bbb6defab89b49e81 Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: method: > Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: exception: Flavor 451 could not be found. Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: action_args: {'id': '451'} Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 13:54:13.569221 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:13.570143 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jul 15 13:54:13.571157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f0db93ee-f8c5-4ef6-a064-f513b017e23f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 13:54:13.572124 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-f0db93ee-f8c5-4ef6-a064-f513b017e23f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011776 Jul 15 13:54:13.572124 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:54:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 13:54:14.573611 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:14.574624 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 15 13:54:14.575019 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:15.120232 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5e52909f-6809-429c-9ed9-ce8251fd8a0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:54:15.139904 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5e52909f-6809-429c-9ed9-ce8251fd8a0a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.428458 Jul 15 13:54:15.140475 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jul 15 13:54:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:54:16.169133 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:16.170255 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jul 15 13:54:16.170666 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:16.845266 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-84bed982-46a3-4194-b930-a2a8edf7f29b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:54:16.864030 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-84bed982-46a3-4194-b930-a2a8edf7f29b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.553033 Jul 15 13:54:16.864611 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jul 15 13:54:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 13:54:17.889525 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:17.890529 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 15 13:54:17.890932 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:18.503959 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6f15e675-6fec-465d-9ef9-cafe09409383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:54:18.532789 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6f15e675-6fec-465d-9ef9-cafe09409383 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.503828 Jul 15 13:54:18.533795 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jul 15 13:54:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:54:19.640368 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:19.641745 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Jul 15 13:54:19.642253 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:20.249408 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-424f7ece-c8ee-4d9e-abbc-7e955d8b3e67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 13:54:20.270075 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-424f7ece-c8ee-4d9e-abbc-7e955d8b3e67 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.485220 Jul 15 13:54:20.270624 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jul 15 13:54:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 13:54:21.346931 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:21.347976 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 15 13:54:21.348382 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:54:21.958333 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2bd5980c-deaf-4639-91fc-ecd302063748 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:54:21.992187 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2bd5980c-deaf-4639-91fc-ecd302063748 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.501359 Jul 15 13:54:21.993662 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Jul 15 13:54:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:55:15.290371 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.291379 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3195db2c-1744-4ef8-a714-62d4fef27659 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 15 13:55:15.292516 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:55:15.302391 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:55:15.688884 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c44cc788-cf74-4961-8f1a-1bdcd8c55006 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.708298 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c44cc788-cf74-4961-8f1a-1bdcd8c55006 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410232 Jul 15 13:55:15.708786 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:55:15.730513 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=14 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:55:15.734376 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-5e8f1623-e86e-43ac-85f0-51a02654baba admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.742293 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-5e8f1623-e86e-43ac-85f0-51a02654baba admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013234 Jul 15 13:55:15.742837 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:55:15.754886 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6cc27349-e983-4a08-bfc9-819e4cb7feb7 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.764950 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6cc27349-e983-4a08-bfc9-819e4cb7feb7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013948 Jul 15 13:55:15.765514 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:55:15.778370 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.786188 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011477 Jul 15 13:55:15.786733 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:55:15.799443 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-e1f209bc-e0dc-478b-8772-8984dc02c231 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:55:15.807324 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-e1f209bc-e0dc-478b-8772-8984dc02c231 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011595 Jul 15 13:55:15.807864 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jul 15 13:55:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 13:58:50.941672 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:58:50.942732 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 15 13:58:50.943134 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:58:51.086851 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=6 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:58:51.247488 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:58:51.248675 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:58:51.248675 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:58:51.249861 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:58:51.250298 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:58:51.251068 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:58:51.251493 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:58:51.285034 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2bb67936-e26c-44dd-bf58-a77fc403c51a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199583 Jul 15 13:58:51.285625 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:58:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:58:52.117160 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:58:52.118164 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 15 13:58:52.118564 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:58:52.317954 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:58:52.319179 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:58:52.319179 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:58:52.320352 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:58:52.320816 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:58:52.321614 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:58:52.322036 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:58:52.341627 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-294e63a9-dfed-46fd-aacd-8084f3e36f24 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081565 Jul 15 13:58:52.342070 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:58:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 13:59:03.587142 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:59:03.588156 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Jul 15 13:59:03.588594 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 13:59:03.733136 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=4 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:59:03.733862 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell1:SELECT=4 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:59:03.734484 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=8 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 13:59:03.782528 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:59:03.783683 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:59:03.783683 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:59:03.784879 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:59:03.785331 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:59:03.786083 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:59:03.786505 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:59:03.811171 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-17740bfc-44fe-4742-b2fe-52089d95032e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082765 Jul 15 13:59:03.811718 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:59:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 13:59:04.653181 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:59:04.654181 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f42c45cf-3515-4c6d-a91f-2239b8842481 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 15 13:59:04.654581 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jul 15 13:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 13:59:04.846541 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 13:59:04.847712 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 13:59:04.847712 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jul 15 13:59:04.848911 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:59:04.849355 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:59:04.850157 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 13:59:04.850611 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 13:59:04.873090 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-bd55c942-033b-4d2b-b63a-f0593c156291 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078875 Jul 15 13:59:04.873771 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jul 15 13:59:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:00:03.202292 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: Fri Jul 15 14:00:03 2022 - graceful shutdown triggered... Jul 15 14:00:03.202835 dv-cinder-850002-1-iscsi devstack@n-api.service[103134]: Gracefully killing worker 2 (pid: 103134)... Jul 15 14:00:03.202415 dv-cinder-850002-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 15 14:00:03.203618 dv-cinder-850002-1-iscsi devstack@n-api.service[103133]: Gracefully killing worker 1 (pid: 103133)... Jul 15 14:00:04.203441 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: worker 1 buried after 1 seconds Jul 15 14:00:04.203908 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: worker 2 buried after 1 seconds Jul 15 14:00:04.203908 dv-cinder-850002-1-iscsi devstack@n-api.service[103132]: goodbye to uWSGI. Jul 15 14:00:04.205201 dv-cinder-850002-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 15 14:00:04.205748 dv-cinder-850002-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 15 14:00:04.208689 dv-cinder-850002-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 14:00:04.219677 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 14:00:04.222313 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 14:00:04 2022] *** Jul 15 14:00:04.222474 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 14:00:04.222605 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 14:00:04.222719 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: nodename: dv-cinder-850002-1-iscsi Jul 15 14:00:04.222845 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: machine: x86_64 Jul 15 14:00:04.222963 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: clock source: unix Jul 15 14:00:04.223063 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: pcre jit disabled Jul 15 14:00:04.223153 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: detected number of CPU cores: 4 Jul 15 14:00:04.223272 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: current working directory: / Jul 15 14:00:04.223380 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: detected binary path: /usr/bin/uwsgi-core Jul 15 14:00:04.223495 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: your processes number limit is 47680 Jul 15 14:00:04.223611 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: your memory page size is 4096 bytes Jul 15 14:00:04.223736 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: detected max file descriptor number: 2048 Jul 15 14:00:04.223848 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: lock engine: pthread robust mutexes Jul 15 14:00:04.224121 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: thunder lock: enabled Jul 15 14:00:04.224444 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 14:00:04.224643 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 14:00:04.265137 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: Python main interpreter initialized at 0x5587dc8f69c0 Jul 15 14:00:04.265137 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: python threads support enabled Jul 15 14:00:04.265137 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: your server socket listen backlog is limited to 100 connections Jul 15 14:00:04.265137 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: your mercy for graceful operations on workers is 90 seconds Jul 15 14:00:04.265603 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 14:00:04.265603 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: *** Operational MODE: preforking *** Jul 15 14:00:04.265862 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: *** uWSGI is running in multiple interpreter mode *** Jul 15 14:00:04.265862 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: spawned uWSGI master process (pid: 117846) Jul 15 14:00:04.266230 dv-cinder-850002-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 14:00:04.268290 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: spawned uWSGI worker 1 (pid: 117861, cores: 1) Jul 15 14:00:04.268290 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: spawned uWSGI worker 2 (pid: 117862, cores: 1) Jul 15 14:00:04.268290 dv-cinder-850002-1-iscsi devstack@n-api.service[117846]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 14:00:04.942666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 14:00:04.945336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 14:00:06.133439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 14:00:06.133439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: from cryptography.utils import int_from_bytes Jul 15 14:00:06.134242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 14:00:06.134242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: from cryptography.utils import int_from_bytes Jul 15 14:00:06.135147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 14:00:06.135147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: from cryptography.utils import int_from_bytes Jul 15 14:00:06.135601 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 14:00:06.135601 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: from cryptography.utils import int_from_bytes Jul 15 14:00:08.483124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 14:00:08.483758 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 14:00:08.483851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 14:00:08.484191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 14:00:08.484475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 14:00:08.484874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.485204 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.485530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.485860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.486189 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.486505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.486834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.487166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.487492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.487760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.488081 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.488430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850002-1-iscsi {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.488768 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.489080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.489397 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.489723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.490034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.490362 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.490673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.491172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.492682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.492682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.492897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 14:00:08.493273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.493350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 14:00:08.493430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.493430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.493581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 14:00:08.493653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.493721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 14:00:08.493796 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.493873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 14:00:08.493968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.494052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.494135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.494438 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.494658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.494873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.495644 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850002-1-iscsi {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.495870 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.496088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.496306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.496561 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.496907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.497125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.497339 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.497544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.497762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.497978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.498197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.498411 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.498616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.498616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.499045 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.499264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850002-1-iscsi {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.499489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.499697 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.499902 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.500093 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.500268 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.500496 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.500667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.500873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501028 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501330 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501827 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.501981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.502266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.502448 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.502598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.502753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.502942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.503934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504256 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504589 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504741 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.504891 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505050 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505218 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.505835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506437 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506580 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506731 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850002-1-iscsi {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.506882 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507178 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507485 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507635 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.507934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508086 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508240 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508438 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508599 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508751 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.508912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509070 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509217 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509697 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.509997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.510148 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.510309 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.510464 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.510670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.511359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.511514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.511669 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.511827 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.511982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512282 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512819 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.512973 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.513128 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.513458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514139 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.514917 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.515994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.516942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517235 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517672 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.517829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518017 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518486 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518783 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.518937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519390 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.519989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520295 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520464 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520775 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.520926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.521963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522408 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522558 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.522861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.523011 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.523162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.523162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.523595 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.523595 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.524545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.524736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.524890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525771 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.525913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526810 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.526962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527111 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527703 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.527931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.528905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529048 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529501 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.529958 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530537 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.530994 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531142 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.531889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.532966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.533109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.533259 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.533259 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.533685 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.533869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.534555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.534708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.534859 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.535010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.535174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.535320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.535470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.535615 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.535765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.535916 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.536068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.536212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.536367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.536579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.536723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.536873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.537024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.537177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.537320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.537462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.537614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.537767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.537923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.538074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.538217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.538358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.538507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.538663 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.538816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.538969 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.539126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.539283 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.539427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.539579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.539729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.539873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.540021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.540172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.540322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.540506 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.540657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.540801 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.540960 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.541104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.541104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.541395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.541549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.541699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.542349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 14:00:08.542493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.542649 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.542800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.542959 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543407 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543558 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.543872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.544831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.544998 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545150 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.545911 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546068 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546651 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.546943 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547240 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547383 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547526 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547827 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.547990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548750 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.548908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549066 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549215 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549508 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549651 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.549968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550118 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550269 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550770 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.550924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551363 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551519 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.551975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552120 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552270 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552651 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.552946 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.553089 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.553239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.553404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.553557 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.553701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.554026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.554177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.554590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555580 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.555956 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.556261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.556430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.556582 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.556745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.556956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.557113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.557266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.557445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.557629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.558281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.558426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.558579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.558741 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.558886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559029 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559348 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.559965 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560613 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.560902 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561051 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561513 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561655 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561799 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.561948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562414 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562559 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.562862 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563160 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563466 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.563772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.564202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.564398 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.565387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.565540 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.565683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.565836 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.565990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566142 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566441 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.566936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567086 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567399 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.567896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568193 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568563 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568732 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.568877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569175 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.569912 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570054 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.570977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571273 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.571896 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572209 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572840 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.572997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.573938 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.574082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.574441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.574603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576108 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576468 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576637 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.576928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577241 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.577968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578131 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578588 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.578889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579506 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579793 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579944 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.579944 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.580242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.580517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.580681 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.580825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.580967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581573 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.581882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582036 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582472 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.582924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.583980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.584122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.584365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.584717 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.584900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.585334 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.585488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.585640 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.585803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.586372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.586538 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.586694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.586839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.586994 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587139 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587592 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.587886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588181 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588501 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588833 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.588989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.591642 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.591830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.591987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.592983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593278 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593432 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593742 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.593891 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594041 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594189 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594819 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.594987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.595381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.595549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.595715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.595866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.596047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.596546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.596720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.596873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597033 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597190 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597649 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.597967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598118 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598590 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598754 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.598991 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599389 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599532 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.599944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600081 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600492 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600751 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.600890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.601975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602386 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602515 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.602924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603326 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603719 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.603992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.604136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.605533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.605679 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.605824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.605963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.606092 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.606236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.606645 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.606868 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.607987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608115 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608794 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.608932 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609331 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.609996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610125 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610266 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610663 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610801 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.610945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.611879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612691 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.612828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613600 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.613875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614278 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.614839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.615102 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.615256 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.615802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.615933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.616072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.616203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.616203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.616478 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.616820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.617898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618035 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618035 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618420 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618689 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618818 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.618947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619207 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619207 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.619886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.620680 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.620824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.620953 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.620953 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.621948 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622361 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622361 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622612 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.622876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623508 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623636 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623772 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.623907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624282 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624843 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.624843 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.625091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.625226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.625368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.625853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.625853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626120 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.626654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.627753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.627753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628027 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628027 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628273 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628561 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.628703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629037 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629167 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.629824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630078 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.630509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631863 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.631993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632482 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632614 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.632886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633665 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.633936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634369 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634642 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.634778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.635035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.635166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.635307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.635437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.635437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636897 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.636897 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.637227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.637366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.637784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.637918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.637918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638833 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.638963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.639872 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640611 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.640893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641283 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.641936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642330 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642977 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.642977 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643239 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643645 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643645 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.643910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.644038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.644038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.644305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645003 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645150 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645660 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.645660 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.646972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.647121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.647334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.647334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.647597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.647597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648108 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648845 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.648977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649660 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.649928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.650189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.650900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651038 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.651861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652000 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652139 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.652927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653474 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653474 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653728 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.653870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654001 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654138 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.654809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.655866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.656539 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.656673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.656673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.656934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.657128 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.657259 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.657575 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.657709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658050 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658302 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658574 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.658850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659652 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.659789 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.660022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.660155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.660355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.660552 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.660720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661002 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.661951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662782 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.662988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.663218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.663365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.664807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665360 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665773 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.665988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.666362 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.666524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.666632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.666772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.667559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.667675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.667891 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668422 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.668937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669157 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.669880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670102 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670417 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.670841 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671360 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671460 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.671795 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672142 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.672799 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673639 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673739 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.673966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674273 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.674987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.675932 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.676937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.677158 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.677266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.677582 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.677759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.677892 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678216 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678717 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.678865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679041 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679362 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679469 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.679775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680330 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680771 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.680996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.681972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682752 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.682996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.683584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.683821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.683923 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684142 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684847 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.684950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685458 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.685864 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686175 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.686998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687309 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687766 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.687948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688636 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.688961 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.689082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.689266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.689375 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.689616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.689936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.690264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.690586 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.691116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.691463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.691679 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.691771 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.692040 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.692131 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.692435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.692540 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.692763 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.693088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.693421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.693738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.693980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694782 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.694968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695399 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.695923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696248 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696605 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696727 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.696938 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697141 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697502 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697627 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.697941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698301 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.698993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699154 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699653 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699798 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.699968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700465 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700623 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.700935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701561 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.701875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702349 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702669 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702799 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.702975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703306 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.703948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704369 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704750 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.704968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.705999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706218 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706628 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.706936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.707885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708105 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708613 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.708928 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709118 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.709841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710056 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710466 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710688 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.710784 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711353 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.711894 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.712955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713168 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713815 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.713917 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714744 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.714839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715702 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.715804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716114 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716780 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.716989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717299 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.717932 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718371 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718561 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.718966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719181 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719492 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719801 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.719899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720553 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.720851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721163 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721384 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721485 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.721790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722014 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722108 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722445 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.722970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.723070 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.723279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.723383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.723591 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.723713 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724129 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724706 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.724811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725205 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.725993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726323 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726640 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726816 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.726978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.727123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.727325 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.727428 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.727668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.727798 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728005 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.728972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.729103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.730212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.730350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.730548 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.730675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.730863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.731013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.731355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.731450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.731694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.731796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732037 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732138 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.732810 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.733983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734610 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.734921 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735228 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.735956 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736158 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.736904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737213 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.737918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738369 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738787 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.738985 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739078 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739595 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.739993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740211 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.740975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.741890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.742880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743388 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.743794 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744009 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744330 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744449 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744676 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.744768 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.745036 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.745638 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.745902 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.745997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.746220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.746320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.746558 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.746752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.746880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.747880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748078 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748593 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748718 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.748837 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749028 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749142 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749352 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749663 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749756 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.749974 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750692 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.750904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751006 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751526 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.751990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752506 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752814 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.752919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753120 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753428 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753738 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.753832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 14:00:08.754076 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.754393 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.754708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.755024 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.755337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.755648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.755960 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.756268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.756600 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.756916 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.757244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.757558 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.757863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.758285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.758596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.758916 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.759233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.759542 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.759862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.760184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.760572 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.760861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.761176 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.761503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.761842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.762171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.762634 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.762805 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.763117 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.763420 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.763730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.764047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.764360 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.764682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.765023 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.765336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.765640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.765944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.766249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.766585 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.766897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.767279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.767499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.767840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.768103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.768421 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.768729 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.769043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.769344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.769646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.769945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.770247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.770548 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.770889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.771229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.771545 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.771868 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.772181 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.772527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.772839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.773230 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.773485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.773832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.774145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.774479 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.774789 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.775099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.775410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.775721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.776030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.776370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.776726 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.777051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.777358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.777688 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.778006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.778331 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.778646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.778956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.779286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.779594 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.779907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.780217 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.780550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.780861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.781183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.781495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.781806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.782124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.782441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.782770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.783101 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.783412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.783734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.784059 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.784432 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.784751 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.785094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.785423 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.785740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.786053 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.786361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 14:00:08.787053 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 14:00:08.906347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO dbcounter [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Registered counter for database nova_api Jul 15 14:00:08.927425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_db.sqlalchemy.engines [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:08.934037 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writer thread running {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:08.939263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO dbcounter [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Registered counter for database nova_api Jul 15 14:00:08.958778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_db.sqlalchemy.engines [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:08.966807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writer thread running {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:08.992759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.context [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9aab78-04cd-4061-be8a-70434796d300(cell1) {{(pid=117861) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 14:00:08.996687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:00:08.998267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:00:08.999057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:00:09.001043 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:00:09.003003 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO dbcounter [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Registered counter for database nova_cell0 Jul 15 14:00:09.007116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO dbcounter [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Registered counter for database nova_cell1 Jul 15 14:00:09.014113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_db.sqlalchemy.engines [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.016255 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_db.sqlalchemy.engines [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.021398 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writer thread running {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.023803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.context [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9aab78-04cd-4061-be8a-70434796d300(cell1) {{(pid=117862) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 14:00:09.028410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:00:09.029987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:00:09.030788 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:00:09.032775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:00:09.034752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO dbcounter [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Registered counter for database nova_cell0 Jul 15 14:00:09.038800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO dbcounter [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Registered counter for database nova_cell1 Jul 15 14:00:09.046737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_db.sqlalchemy.engines [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.047962 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_db.sqlalchemy.engines [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.054687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writer thread running {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.056193 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writer thread running {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.159444 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writer thread running {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.169765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO dbcounter [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Registered counter for database nova_cell0 Jul 15 14:00:09.176486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_db.sqlalchemy.engines [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.181046 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writer thread running {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.205333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO dbcounter [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Registered counter for database nova_cell0 Jul 15 14:00:09.213010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_db.sqlalchemy.engines [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 14:00:09.222724 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writer thread running {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 14:00:09.496698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: WARNING keystonemiddleware.auth_token [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 14:00:09.503874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: WARNING keystonemiddleware.auth_token [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 14:00:09.544171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: WARNING keystonemiddleware.auth_token [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 14:00:09.551576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: WARNING keystonemiddleware.auth_token [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 14:00:09.843164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: WARNING keystonemiddleware.auth_token [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 14:00:09.849161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: WARNING keystonemiddleware.auth_token [None req-682b98cd-78f8-43cd-9fd2-ced30e51514e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 14:00:09.855194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587dc8f69c0 pid: 117861 (default app) Jul 15 14:00:09.897344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: WARNING keystonemiddleware.auth_token [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 14:00:09.903890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: WARNING keystonemiddleware.auth_token [None req-825668b6-1932-4ee7-bc4c-f036cd5823c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 14:00:09.909229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587dc8f69c0 pid: 117862 (default app) Jul 15 14:00:51.287579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:51.289297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:51.290563 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:51.291490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:53.621531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-71d71a8d-320d-424c-a0e9-bbdc017ed7fc tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Action: 'create', calling method: .version_select at 0x7fa0c319b8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-307651318", "metadata": {"Type": "work"}}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:00:55.519474 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-71d71a8d-320d-424c-a0e9-bbdc017ed7fc tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.263119 Jul 15 14:00:55.533618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jul 15 14:00:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4271 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 14:00:55.543133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=3 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:55.543987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=3 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:55.544782 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=3 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:55.550635 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=3 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:00:56.305814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-15adcdc9-61fa-45d4-86a1-d0c45005d62e tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c3066700>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:56.341926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-27e09305-ab1f-410e-bce3-0ba53c17930d tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Calling method '.version_select at 0x7fa0c31e9430>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:56.453088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-15adcdc9-61fa-45d4-86a1-d0c45005d62e tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92325a7c-6aaf-4de1-b9d0-4ee7ab8d2739" status: 200 len: 350 microversion: 2.1 time: 0.151943 Jul 15 14:00:56.453664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:56 2022] GET /compute/v2.1/os-volumes/92325a7c-6aaf-4de1-b9d0-4ee7ab8d2739 => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:00:57.038143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-27e09305-ab1f-410e-bce3-0ba53c17930d tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f" status: 200 len: 353 microversion: 2.1 time: 1.500999 Jul 15 14:00:57.040713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:55 2022] GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f => generated 353 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:00:57.057339 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6ecbf7bd-f8c4-4848-960b-b59403a5a74e tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Calling method '.version_select at 0x7fa0c3066820>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:57.273649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6ecbf7bd-f8c4-4848-960b-b59403a5a74e tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f" status: 200 len: 353 microversion: 2.1 time: 0.221040 Jul 15 14:00:57.274154 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:57 2022] GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:00:57.308737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-24f7f66d-ff74-4e32-ac70-68f048ac0995 tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Calling method '.version_select at 0x7fa0c30ac670>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:57.453094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-24f7f66d-ff74-4e32-ac70-68f048ac0995 tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f" status: 202 len: 0 microversion: 2.1 time: 0.149580 Jul 15 14:00:57.453848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:00:57 2022] DELETE /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:00:57.466718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8b2a879e-d266-4d1d-9011-76d3e62ebacc tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Calling method '.version_select at 0x7fa0c3066ee0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:57.684062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8b2a879e-d266-4d1d-9011-76d3e62ebacc tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f" status: 200 len: 352 microversion: 2.1 time: 0.224975 Jul 15 14:00:57.686040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:57 2022] GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f => generated 352 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:00:58.560732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c3445920-3cd9-4bde-8d79-707324e15aea tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c30acd30>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:58.709379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-09cab97f-3d2c-4d84-b665-6f64baf69e9c tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Calling method '.version_select at 0x7fa0c307c5e0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:00:59.006530 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c3445920-3cd9-4bde-8d79-707324e15aea tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/931ac276-6cd8-44ad-98a3-d31793e250f2" status: 200 len: 350 microversion: 2.1 time: 0.452858 Jul 15 14:00:59.007711 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:58 2022] GET /compute/v2.1/os-volumes/931ac276-6cd8-44ad-98a3-d31793e250f2 => generated 350 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:00:59.153521 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-09cab97f-3d2c-4d84-b665-6f64baf69e9c tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] HTTP exception thrown: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-09cab97f-3d2c-4d84-b665-6f64baf69e9c tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Request method failure captured: Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f HTTP/1.1 Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMThoFpIigrD8gPg7oeObPM1_0_ZjrLqQaT-9Dl7wzNMeFwGv40qw_vcV47cRFPb517Gf1pelM-zhAmVzCuKP-RQ95dQLvKLE4rfAo-t0RYCNs3RVOIxh4IofDfJB3ptW-06HYTDTfzCDdw1bNCXxgWfi3yQTruL_90Z-Uduyn9yVA Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 5807489ec0c7444f9f38f0a90393f80c Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesGetTestJSON-1856733726 Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:00:59.160054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5807489ec0c7444f9f38f0a90393f80c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5807489ec0c7444f9f38f0a90393f80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5807489ec0c7444f9f38f0a90393f80c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5807489ec0c7444f9f38f0a90393f80c"}]}] Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesGetTestJSON-1856733726 Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 5807489ec0c7444f9f38f0a90393f80c Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesGetTestJSON-1856733726 Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesGetTestJSON-1856733726-project Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4e9933d1d47c41379aebf2d0208fa5d9 Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesGetTestJSON-1856733726-project Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '3b46f26a-358d-432b-8844-b76e6f96616f'} Jul 15 14:00:59.161119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. (HTTP 404) (Request-ID: req-2698a7e8-773e-42be-b333-d78d2be51435) Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:00:59.161722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:00:59.162544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 14:00:59.163385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. Jul 15 14:00:59.165442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:00:59.168479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-09cab97f-3d2c-4d84-b665-6f64baf69e9c tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] Returning 404 to user: Volume 3b46f26a-358d-432b-8844-b76e6f96616f could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:00:59.169758 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-09cab97f-3d2c-4d84-b665-6f64baf69e9c tempest-VolumesGetTestJSON-1856733726 tempest-VolumesGetTestJSON-1856733726-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f" status: 404 len: 109 microversion: 2.1 time: 0.476159 Jul 15 14:00:59.174274 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:00:58 2022] GET /compute/v2.1/os-volumes/3b46f26a-358d-432b-8844-b76e6f96616f => generated 109 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:01:01.284980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-918602bb-f541-48cb-92d0-437115d6c7a2 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c30acc10>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:01.438138 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-918602bb-f541-48cb-92d0-437115d6c7a2 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d6fe3189-3e5e-49cd-ba69-db1329c216b9" status: 200 len: 351 microversion: 2.1 time: 0.175965 Jul 15 14:01:01.439253 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:01:01 2022] GET /compute/v2.1/os-volumes/d6fe3189-3e5e-49cd-ba69-db1329c216b9 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:01.455553 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-199dc8f1-2b81-4a5f-ae17-91e5d72f407a tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c3066ee0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:01.733145 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-199dc8f1-2b81-4a5f-ae17-91e5d72f407a tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.286202 Jul 15 14:01:01.741071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jul 15 14:01:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:01.749330 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-147890e8-f98c-4dd3-83ee-c96bc4881702 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c30ac4c0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:02.006112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-147890e8-f98c-4dd3-83ee-c96bc4881702 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.263087 Jul 15 14:01:02.007534 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1148 bytes} [Fri Jul 15 14:01:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:02.025271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b168806f-cd7b-4145-8954-4387c04a7139 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c307cd30>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:02.270470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b168806f-cd7b-4145-8954-4387c04a7139 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.252973 Jul 15 14:01:02.271445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jul 15 14:01:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:02.283933 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-269f21ec-870f-42e4-8de4-2d4772d7750b tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c30ac5e0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:02.530083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-269f21ec-870f-42e4-8de4-2d4772d7750b tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249940 Jul 15 14:01:02.532608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Jul 15 14:01:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:02.555782 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1659ecdc-709c-45cb-a9a3-d05921b01552 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c30835e0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:02.908240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1659ecdc-709c-45cb-a9a3-d05921b01552 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.362309 Jul 15 14:01:02.910417 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Jul 15 14:01:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:02.927096 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-17c4fd8e-d656-4e71-ad25-6f3feba3d1bc tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c307a310>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:03.273650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-17c4fd8e-d656-4e71-ad25-6f3feba3d1bc tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.350890 Jul 15 14:01:03.275038 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jul 15 14:01:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:03.294823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d5e80161-dde0-4ae3-a964-fd5bab3f0f43 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c2feb280>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:03.602536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d5e80161-dde0-4ae3-a964-fd5bab3f0f43 tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.315099 Jul 15 14:01:03.614260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1187 bytes} [Fri Jul 15 14:01:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:03.620531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-aebbac07-7cd7-4b72-aca4-ec850877a29e tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] Calling method '.version_select at 0x7fa0c307c1f0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:03.819031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-aebbac07-7cd7-4b72-aca4-ec850877a29e tempest-VolumesTestJSON-1387159324 tempest-VolumesTestJSON-1387159324-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.203297 Jul 15 14:01:03.833392 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 10/17] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jul 15 14:01:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:03.906117 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-979453436", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:04.226073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] validate_networks() for [('cb1d6404-603d-43fd-9d2d-2304ecd9066f', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:01:07.829026 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:01:07.829594 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:01:07.829980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:01:07.830710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:01:07.831127 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:01:07.908821 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:07.913884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:07.924859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:07.926057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:08.034090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:08.053996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for user b86c21e37e2a49e9bdd48e15b091ce09 and project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:08.086718 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:01:08.091946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:01:08.421743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-49306919-3217-4dad-b27f-e789ef851016 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.871533 Jul 15 14:01:08.448668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 8/18] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:01:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 4899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 14:01:08.450643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a873c68b-882f-4185-8e57-e6b743f7abfc tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:08.454813 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a873c68b-882f-4185-8e57-e6b743f7abfc tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:08.911138 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a873c68b-882f-4185-8e57-e6b743f7abfc tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:08.942397 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a873c68b-882f-4185-8e57-e6b743f7abfc tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1221 microversion: 2.1 time: 0.507559 Jul 15 14:01:08.961576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 11/19] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:08 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1221 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:09.297035 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-755817398", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:09.584724 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d48f75d7-dead-4bc4-80f7-e0e1f96af716 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: .version_select at 0x7fa0c27800d0>, body: {"keypair": {"name": "tempest-keypair-1633826667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj3i6raOje2gTyagwaap5wjFHC4VU7J8157x9SIKUk7KQCCzuVWizanH4sE5yer/K9Wgw9JUWEolLNhDrnLKnQkVSNHBw+DlYLHyZm28OY5/z/6JXpz/1kVZPsxT2TdTw=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:09.621280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] validate_networks() for [('cb1d6404-603d-43fd-9d2d-2304ecd9066f', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:01:09.663911 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-d48f75d7-dead-4bc4-80f7-e0e1f96af716 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for project c160b9f06dad4ee98349dbc63131c20d. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:09.688278 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-d48f75d7-dead-4bc4-80f7-e0e1f96af716 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for user 520583af1f264f22a86722b0cb9ff405 and project c160b9f06dad4ee98349dbc63131c20d. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:09.842245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d48f75d7-dead-4bc4-80f7-e0e1f96af716 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.801173 Jul 15 14:01:09.846062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 9/20] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Jul 15 14:01:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 813 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 15 14:01:10.383261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1915146560", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "networks": [{"uuid": "2d18f5fe-4923-4ff8-9ae4-ee1dbe0e0448"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:10.558555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] validate_networks() for [('2d18f5fe-4923-4ff8-9ae4-ee1dbe0e0448', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:01:12.257477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:01:12.258049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:01:12.259022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:01:12.260598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:01:12.261855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:01:12.307185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:12.316662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:12.321379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:12.321922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:12.360072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:01:12.360907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:01:12.361136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:01:12.361730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:01:12.362416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:01:12.374061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:12.375112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:12.376692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:12.377230 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:12.403576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Getting quotas for project d3c9ca821cd341a98f21ca15a0d6eb4c. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:12.422683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Getting quotas for user 13e70b3794a445fc8deeb5f967eef673 and project d3c9ca821cd341a98f21ca15a0d6eb4c. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:12.464342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:01:12.466677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:01:12.467138 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:12.511623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for user b86c21e37e2a49e9bdd48e15b091ce09 and project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:12.572246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:01:12.579730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:01:12.668518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e622aa1b-236e-4f60-a525-e53e229d5eda tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452513 Jul 15 14:01:12.680137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 10/21] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:01:12.815982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-171a7df0-0153-4ebe-a3ec-482567c81b2b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.527718 Jul 15 14:01:12.824802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 12/22] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:01:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:01:12.835707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-508d2f82-8db3-497e-9e75-0208bcbb80d3 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:12.836906 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-508d2f82-8db3-497e-9e75-0208bcbb80d3 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:13.489533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-508d2f82-8db3-497e-9e75-0208bcbb80d3 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:13.502670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-508d2f82-8db3-497e-9e75-0208bcbb80d3 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1215 microversion: 2.1 time: 0.676241 Jul 15 14:01:13.515668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:12 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1215 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:13.520684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d2224b5d-f3cf-44ec-9c38-0daca843f97e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:13.527866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d2224b5d-f3cf-44ec-9c38-0daca843f97e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:13.599828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4c1a00d0-2853-47fa-864f-09555e02b9d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: .version_select at 0x7fa0c278c550>, body: {"keypair": {"name": "tempest-keypair-476701512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV2CHH8XV3l7RJ6VYSQjRRfWrHAIPHmmEiPt5LpaRhEzw7ltMyLI/dtUIVyvGlNlmyuYSVLl7YNA579EG0pY0Sqfl+mplBAQA40GRQq0zTwVxfyWjecQMo8O73obJoBSg=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:13.686730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-4c1a00d0-2853-47fa-864f-09555e02b9d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:13.725584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-4c1a00d0-2853-47fa-864f-09555e02b9d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for user 96d4c389c4da4d2188e8a32e5ed1be7d and project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:13.800990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4c1a00d0-2853-47fa-864f-09555e02b9d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116952 Jul 15 14:01:13.801803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 11/24] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:01:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:14.005533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d2224b5d-f3cf-44ec-9c38-0daca843f97e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:14.032756 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d2224b5d-f3cf-44ec-9c38-0daca843f97e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1221 microversion: 2.1 time: 0.515678 Jul 15 14:01:14.038937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:13 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1221 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:14.521297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-98b98463-4639-483b-b804-b48f3ca51f9b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:14.521966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-98b98463-4639-483b-b804-b48f3ca51f9b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:14.871020 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-98b98463-4639-483b-b804-b48f3ca51f9b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:14.900464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-98b98463-4639-483b-b804-b48f3ca51f9b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1215 microversion: 2.1 time: 0.383693 Jul 15 14:01:14.912012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 12/26] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:14 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1215 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:15.053639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:15.054584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:15.070064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:15.072262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:15.073218 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:15.076104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:15.478179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:15.503037 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d81e4969-b7a0-4df1-b7b4-4136b0f4fa23 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1225 microversion: 2.1 time: 0.453952 Jul 15 14:01:15.503810 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:15 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1225 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:15.930044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:15.930662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:15.940382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:15.941176 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:15.942141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:15.942722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:16.235730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:16.262767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0a7de385-426a-4080-893f-835f2b3703e1 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1219 microversion: 2.1 time: 0.337013 Jul 15 14:01:16.263534 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:15 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:16.522061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:16.523475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:16.531342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:16.532549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:16.534027 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:16.534819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:16.563141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-972973365", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68380afb-92df-4e5a-adc7-5f1834064646"}], "security_groups": [{"name": "tempest-securitygroup--1109642030"}], "key_name": "tempest-keypair-1633826667", "user_data": "}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:16.640769 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:16.665073 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4be08667-9b6f-4398-81e7-65bf14c7bb11 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1225 microversion: 2.1 time: 0.145388 Jul 15 14:01:16.666831 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:16 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:16.848500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] validate_networks() for [('68380afb-92df-4e5a-adc7-5f1834064646', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:01:17.281962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:17.282795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:17.292928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.293587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.294527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.295739 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.433415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:17.441190 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c23c44a0-a93c-4c5d-8975-7a512c2493a7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1267 microversion: 2.1 time: 0.165229 Jul 15 14:01:17.442442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:17 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:17.684878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:17.685684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:17.706479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.711474 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.714493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.719440 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.807985 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:01:17.808717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:01:17.809455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:01:17.810110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:01:17.811232 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:01:17.842173 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.842617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.843423 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:17.843859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:17.964373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for project c160b9f06dad4ee98349dbc63131c20d. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:17.987622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for user 520583af1f264f22a86722b0cb9ff405 and project c160b9f06dad4ee98349dbc63131c20d. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:18.055314 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:01:18.066607 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:01:18.249316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-10c456e5-f6bd-43d4-9e4b-95b7df75f559 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.690436 Jul 15 14:01:18.249994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 14/31] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jul 15 14:01:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 14:01:18.262186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:18.281849 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:18.574526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:18.583645 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-810ab6ad-3b86-4a7b-b917-406b2f29b2bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1273 microversion: 2.1 time: 0.905917 Jul 15 14:01:18.593296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:17 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1273 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:18.612606 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1903892933", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0460551c-e776-41db-9da0-199d4897f65f"}], "security_groups": [{"name": "tempest-securitygroup--1332492901"}], "key_name": "tempest-keypair-476701512", "user_data": "}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:18.869227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:18.884011 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:18.902973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:18.908842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b7db34d8-8d0a-4252-b74c-fbcc03e9275e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1281 microversion: 2.20 time: 0.651387 Jul 15 14:01:18.914436 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:18 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1281 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:18.925105 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:18.936672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:18.964985 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:18.965672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:18.970657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:18.972416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:19.070278 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] validate_networks() for [('0460551c-e776-41db-9da0-199d4897f65f', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:01:19.608838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:19.639617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-63665db4-bb04-4908-a04c-80b73c4c3173 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1273 microversion: 2.1 time: 0.718338 Jul 15 14:01:19.672090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 16/34] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:18 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1273 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:19.686264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:19.697329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:19.739711 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:19.740257 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:19.741141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:19.741593 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:20.202981 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:20.228553 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a9adfdb0-c1fa-4620-ab7f-871ef671a130 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1279 microversion: 2.1 time: 0.545117 Jul 15 14:01:20.230161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:19 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1279 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:20.268963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:20.276745 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:20.359166 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:20.361929 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:20.363992 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:20.367511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:20.875680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:20.893805 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:20.901365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:20.903321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3f4a55a7-904e-4a8d-8537-f2a4325f137a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1333 microversion: 2.20 time: 0.660758 Jul 15 14:01:20.905264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:20 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1333 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:20.919352 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:20.920887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:20.950684 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:20.951428 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:20.954425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:20.959951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:21.389780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:21.420806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-de19c3ff-f270-45e2-b1c7-72cb30b430ea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1273 microversion: 2.1 time: 0.513542 Jul 15 14:01:21.425306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 19/37] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:20 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1273 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:21.452524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:21.453587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:21.475261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:21.484139 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:21.486796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:21.487785 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:22.417637 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:22.603509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:22.628256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d13fe1de-c21b-4cc1-9e6c-9cf1824a8da4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1279 microversion: 2.1 time: 1.200964 Jul 15 14:01:22.631076 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:21 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1279 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:22.649656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:22.652287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:22.683284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:22.684102 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:22.686283 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:22.688790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:22.896512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:22.921640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:22.924488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:22.929332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f1e85825-209c-4407-83e3-1690e0709f9b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1339 microversion: 2.20 time: 0.295497 Jul 15 14:01:22.930036 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:22 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1339 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:22.949258 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:22.952383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:22.975171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:22.978706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:22.980113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:22.987605 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:24.014098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=12 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:24.786477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:24.810797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-61825440-28e4-43b7-b902-c2fd3df47160 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 1.879424 Jul 15 14:01:24.811357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:22 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:24.818438 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:01:24.818867 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:01:24.819347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:01:24.819755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:01:24.820050 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:24.820167 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:01:24.834040 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:24.846435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:24.852655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:24.854466 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:24.857354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:24.858861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:24.862202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:24.862657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:24.870512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:24.870512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:24.951730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:01:24.972854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for user 96d4c389c4da4d2188e8a32e5ed1be7d and project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:01:25.008607 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:01:25.015162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:01:25.146104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ba5eb6bc-f116-4248-8ca9-40fa4f985c2b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.551432 Jul 15 14:01:25.147295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 19/41] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:01:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 6553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:01:25.166504 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:25.170835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:25.193849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:25.194746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:25.195830 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:25.197188 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:25.587826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:25.602887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:25.618278 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:25.625984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1adc8e07-0e34-43ee-85fe-fad08dc71ad5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1339 microversion: 2.20 time: 0.476251 Jul 15 14:01:25.626576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 20/42] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:25 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1339 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:25.648425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c24afeba-aee6-4657-a6d3-1881e69121c7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:25.653170 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c24afeba-aee6-4657-a6d3-1881e69121c7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:25.841393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c24afeba-aee6-4657-a6d3-1881e69121c7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:25.849552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c24afeba-aee6-4657-a6d3-1881e69121c7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1237 microversion: 2.1 time: 0.212739 Jul 15 14:01:25.850187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:25 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1237 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:25.864048 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:25.865624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:25.867083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:25.872446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f458e006-4230-474a-932f-504a7edc6547 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 1.060021 Jul 15 14:01:25.873098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 23/44] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:24 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:25.886188 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:25.888843 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:25.890112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:25.894392 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:26.491315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:26.504353 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fd572827-e9c5-49f1-a90d-0732d9f2d564 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.641009 Jul 15 14:01:26.507161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 22/45] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:25 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:26.651328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:26.652244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:26.680940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:26.680940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:26.688433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:26.688433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:26.869039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:26.870463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:26.892161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:26.895439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:26.897676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:26.902506 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:27.171268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:27.200106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:27.208606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:27.214464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-52de60c4-a77b-4195-865d-f4aa3b0f2f3b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1339 microversion: 2.20 time: 0.568182 Jul 15 14:01:27.236543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:26 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1339 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:27.248580 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:27.260038 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:27.260489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-05972b81-c2f0-4fc4-94fb-cb06aff4b9e2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1241 microversion: 2.1 time: 0.395718 Jul 15 14:01:27.260696 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:27.261124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:26 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1241 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:27.290087 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:27.290650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:27.291847 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:27.292289 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:27.524711 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:27.525995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:27.546325 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:27.546779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:27.547609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:27.548022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:27.917693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=6 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:28.159667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:28.167949 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-63b7d42e-58f0-4710-9a49-2c4c3ebaed6d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.929526 Jul 15 14:01:28.168566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:27 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:28.237226 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:28.238018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:28.255104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:28.255544 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:28.256482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:28.278046 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:28.475068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:28.493229 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-469b3188-233e-41b1-9887-ba2078cb8f0c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.972879 Jul 15 14:01:28.494061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 24/49] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:27 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:28.517316 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:28.517857 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:28.567527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:28.580018 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:28.585366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:28.586267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:28.874337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=30 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:29.387290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:29.407656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2503254a-c4ed-4764-ae59-47dadb959362 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1233 microversion: 2.1 time: 0.907036 Jul 15 14:01:29.412777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 25/50] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:28 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1233 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:29.421629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:29.462743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:29.471392 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:29.476593 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-84c56d39-366e-4451-926a-01cd8090f261 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 1.242161 Jul 15 14:01:29.482423 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:28 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:01:29.506958 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:29.508422 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:29.521515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.521989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.523099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.523901 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.570527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-4dc6dc08-4783-48b8-9773-0c311e3ed062 req-a3f7204b-5b8a-46b4-a7d6-0a4afe1d6e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6bc8f0-81aa-45df-9fb1-4e581cf0913e", "tag": "c7be0622-dca5-4205-98fa-99c86a79c041"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:29.590782 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-4dc6dc08-4783-48b8-9773-0c311e3ed062 req-a3f7204b-5b8a-46b4-a7d6-0a4afe1d6e26 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.591225 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-4dc6dc08-4783-48b8-9773-0c311e3ed062 req-a3f7204b-5b8a-46b4-a7d6-0a4afe1d6e26 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.635522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-4dc6dc08-4783-48b8-9773-0c311e3ed062 req-a3f7204b-5b8a-46b4-a7d6-0a4afe1d6e26 service nova] Creating event network-changed:c7be0622-dca5-4205-98fa-99c86a79c041 for instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e on hv-cinder-85000 Jul 15 14:01:29.635985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-4dc6dc08-4783-48b8-9773-0c311e3ed062 req-a3f7204b-5b8a-46b4-a7d6-0a4afe1d6e26 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 14:01:29.637148 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.637594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.638381 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.641319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.661673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.compute.rpcapi [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 14:01:29.662599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] Releasing lock "compute-rpcapi-router" {{(pid=117861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 14:01:29.688565 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d478c419-df2a-49cb-82a8-dbbe6f795164 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274119 Jul 15 14:01:29.689179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 26/52] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:29.697505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:29.698213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:29.707002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.707480 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:29.708342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:29.708872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.110786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:30.125179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f23702df-4d0d-48a5-9e2d-ded7d9d9543c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.641384 Jul 15 14:01:30.129587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 27/53] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:29 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:30.335930 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:30.345437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9acdae0d-2ddd-4a2c-83c9-f885bb2555b4 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.651992 Jul 15 14:01:30.346946 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:29 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:30.430261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:30.430957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:30.437807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.438698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.439650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.440864 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.499176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:30.500060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:30.550041 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.550127 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.550943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.551387 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.573877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:30.585086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-36750162-c0e1-4f99-a274-dd7a222cd6d1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1233 microversion: 2.1 time: 0.158822 Jul 15 14:01:30.586601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:30 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1233 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:30.746476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-8b0273f5-fa35-4e22-934d-874a8e24648d req-5473abcc-c6ff-428a-b949-eb018ffdffbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bc879c-c169-47cb-a214-86d5850a55ec", "tag": "0861b4f1-fb2d-42f9-b72b-e415301f1546"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:30.773261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-8b0273f5-fa35-4e22-934d-874a8e24648d req-5473abcc-c6ff-428a-b949-eb018ffdffbf service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.777229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-8b0273f5-fa35-4e22-934d-874a8e24648d req-5473abcc-c6ff-428a-b949-eb018ffdffbf service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.833908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-8b0273f5-fa35-4e22-934d-874a8e24648d req-5473abcc-c6ff-428a-b949-eb018ffdffbf service nova] Creating event network-changed:0861b4f1-fb2d-42f9-b72b-e415301f1546 for instance 89bc879c-c169-47cb-a214-86d5850a55ec on hv-cinder-85000 Jul 15 14:01:30.834636 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-8b0273f5-fa35-4e22-934d-874a8e24648d req-5473abcc-c6ff-428a-b949-eb018ffdffbf service nova] Acquired lock "compute-rpcapi-router" {{(pid=117862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 14:01:30.836746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.840058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.842487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:30.846214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:30.875121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.compute.rpcapi [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 14:01:30.880652 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] Releasing lock "compute-rpcapi-router" {{(pid=117862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 14:01:30.926830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c61ba1e6-7b89-4bee-814b-c6a45f64618e None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312310 Jul 15 14:01:30.934577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:31.086062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:31.103468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:31.121087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:31.122268 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-af883e9e-10dc-4c0a-a354-2d2fcbc9b8fd tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.628524 Jul 15 14:01:31.122941 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:30 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:31.148962 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:31.150153 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:31.171361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:31.175796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:31.178074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:31.178576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:31.366234 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:31.367431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:31.374938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:31.387881 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:31.390952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:31.391413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.351905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:32.362139 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:32.406474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=100 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:32.422124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-86d352ae-e03d-4c4e-9603-16e07a02b0b9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 1.277589 Jul 15 14:01:32.429775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:31 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:32.434004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fac89d23-98d2-4790-880c-064a79660291 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 1.067814 Jul 15 14:01:32.434730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:31 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:32.503243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-827a532c-2b82-4b8c-8006-9b79388fe5d3 req-77aad599-12ac-4391-a186-53a8c4511154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c49059-61d4-4969-96dc-a92d8f3d4cb9", "tag": "d7c665a6-0206-4af0-9832-e67d770dfcea"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:32.510903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:32.511790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:32.527146 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:32.527768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.528736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:32.529440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.559692 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:32.587236 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-827a532c-2b82-4b8c-8006-9b79388fe5d3 req-77aad599-12ac-4391-a186-53a8c4511154 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:32.597097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-827a532c-2b82-4b8c-8006-9b79388fe5d3 req-77aad599-12ac-4391-a186-53a8c4511154 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.688847 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-827a532c-2b82-4b8c-8006-9b79388fe5d3 req-77aad599-12ac-4391-a186-53a8c4511154 service nova] Creating event network-changed:d7c665a6-0206-4af0-9832-e67d770dfcea for instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 on hv-cinder-85000 Jul 15 14:01:32.723099 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-827a532c-2b82-4b8c-8006-9b79388fe5d3 req-77aad599-12ac-4391-a186-53a8c4511154 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258720 Jul 15 14:01:32.723763 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:32.786185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:32.788698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:32.836839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:32.842688 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.846241 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:32.856105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:32.888927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:32.915798 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-09afccaa-7990-4cba-a783-b7ce6850618c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1307 microversion: 2.1 time: 0.481470 Jul 15 14:01:32.931282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:32 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:33.451647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:33.452409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:33.494632 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:33.504055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:33.505471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:33.509552 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:34.711374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:34.727516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-05dd2f32-6f81-4d6f-b591-a8366896d404 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 1.286277 Jul 15 14:01:34.731372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 32/62] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:33 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:34.750898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:34.753253 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:34.768430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:34.769203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:34.776303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:34.777009 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:34.804026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:34.843341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:34.852109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:34.856492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0cab440b-07c3-4bca-982b-f918bb23ce75 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 2.125003 Jul 15 14:01:34.858379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 31/63] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:32 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:34.872652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:34.874317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:34.892320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:34.893062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:34.894405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:34.895008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:35.244026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:35.270091 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1ace19a5-40e7-49a6-bf47-c5a7d3126415 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1295 microversion: 2.1 time: 0.404509 Jul 15 14:01:35.272009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:34 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1295 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:35.748691 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:35.749320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:35.762241 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:35.765447 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:35.766629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:35.767744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:35.862077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=8 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:36.084128 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.096090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d0354e1b-281b-4afa-a67b-698204c46bef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 1.360393 Jul 15 14:01:36.121231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:34 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:36.135706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:36.138327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:36.150405 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:36.153482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:36.156048 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:36.157832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:36.220488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.229981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:36.236849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-027c7c5b-c6f0-469f-83af-911e245762bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.492746 Jul 15 14:01:36.240007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:35 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:36.291731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:36.292350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:36.309606 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:36.310633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:36.311503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:36.314163 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:36.481315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.503642 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-94b9cb17-880f-42b4-af6f-51996e6ed28f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1295 microversion: 2.1 time: 0.216848 Jul 15 14:01:36.516506 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:36 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:36.536949 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-b9a96c82-8583-4593-9bab-3cc567558e62 req-fdbeb266-5787-4bc0-b033-017b5ae209e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:36.540764 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.555862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.560189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:36.561419 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b9a96c82-8583-4593-9bab-3cc567558e62 req-fdbeb266-5787-4bc0-b033-017b5ae209e0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:36.563187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b9a96c82-8583-4593-9bab-3cc567558e62 req-fdbeb266-5787-4bc0-b033-017b5ae209e0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:36.564766 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e7a77fa5-d003-408e-ba82-22df0a3fa6df tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.441143 Jul 15 14:01:36.565912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:36 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:36.601242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-b9a96c82-8583-4593-9bab-3cc567558e62 req-fdbeb266-5787-4bc0-b033-017b5ae209e0 service nova] Creating event network-changed:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:01:36.608784 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-b9a96c82-8583-4593-9bab-3cc567558e62 req-fdbeb266-5787-4bc0-b033-017b5ae209e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078942 Jul 15 14:01:36.609546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 35/69] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:01:37.119545 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:37.120168 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:37.133328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.135047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.139081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.139829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.260841 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:37.261555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:37.276872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.278755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.279798 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.281079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.321263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.330032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-983ddb81-5a97-4fe8-b8c9-1c22bd2c961c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.219927 Jul 15 14:01:37.333861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 35/70] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:37 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:37.458445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.470240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-017bcb04-021b-4734-a5cf-44de4afcdd08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.215671 Jul 15 14:01:37.473324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 36/71] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:37 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:37.527168 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:37.529265 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:37.541535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.542461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.544159 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.545243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.592770 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:37.593842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:37.610316 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.610952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.612281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:37.613051 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:37.795188 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.805897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2a791ecb-d10e-4a20-9d8a-3d8152e1271f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.287091 Jul 15 14:01:37.816870 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:37 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:37.868653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.883413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.886951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:37.889183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f14d66fa-1bce-4f6b-a650-ba27ec16abca tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.303180 Jul 15 14:01:37.890566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 37/73] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:37 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:38.360008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:38.362960 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:38.383256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.384024 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.388970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.389763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.491667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:38.493224 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:38.501930 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.502772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.503694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.504377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.817658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:38.824246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:38.826619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5250cf9d-0148-467e-a127-6fc1f1775b79 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.474068 Jul 15 14:01:38.833010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:38 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:38.836185 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:38.836594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9545f375-516e-4e8f-b4c9-7d0f692d4e40 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.350040 Jul 15 14:01:38.837171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 38/75] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:38 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:38.841583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:38.854675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.855361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.857420 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.857835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.907522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:38.909921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:38.923113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.925328 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:38.926465 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:38.927156 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:39.081090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:39.090843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2e6c93ef-accc-43c9-a2d3-fcdf9d0ab511 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.260099 Jul 15 14:01:39.091996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:38 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:39.149892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:39.158825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:39.160365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:39.161533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-69596e74-f105-40e5-9a67-204400b2d47e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.258023 Jul 15 14:01:39.162426 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 39/77] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:38 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:01:39.849653 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:39.850420 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:39.857456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:39.858097 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:39.859385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:39.859786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:39.860366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:39.860951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:39.863062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=4 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:39.874825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:39.875805 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:39.877610 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:39.879002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:40.167767 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.196104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0211f6d0-eb5f-4e15-b905-20e0aa08e8b8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.337964 Jul 15 14:01:40.203537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 40/78] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:39 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:40.219626 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:40.221302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:40.233500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:40.234381 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:40.236305 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:40.237321 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:40.321221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.333638 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d829ed74-b4df-43b1-9326-37db8f71a81a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.489484 Jul 15 14:01:40.334963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 39/79] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:39 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:40.361612 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:40.363103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:40.388497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:40.389044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:40.390596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:40.391033 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:40.554175 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.565868 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-907100c5-df0e-48d2-b42f-42c2cb584139 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.359360 Jul 15 14:01:40.566967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:40 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:40.616974 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.625953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.627654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:40.629200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1ec6ddff-8df0-4d4d-8308-4b5f68038c42 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.292552 Jul 15 14:01:40.630022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 40/81] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:40 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:41.233777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:41.234400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:41.246032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.246495 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.247400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.247718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.372786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:41.374597 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:41.407044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:41.409854 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.410601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.417702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.418427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.487518 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:41.501244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-be3ef768-6193-4d5e-a4ef-b664ca682595 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.272676 Jul 15 14:01:41.501838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 42/82] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:41 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:41.586583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:41.586583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:41.595921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.596374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.597260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.597726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.833689 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:41.846449 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-677060ed-a967-4ca5-9a63-b0b9dc6b4ed9 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.492631 Jul 15 14:01:41.848778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 41/83] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:41 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:41.859699 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:41.860536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:41.867876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.868459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.869875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:41.870551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:41.873923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:41.883136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-934b7857-55fc-4e13-a02e-898e8a2703c5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.301532 Jul 15 14:01:41.886056 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:41 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:42.311776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:42.326750 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:42.330316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:42.332186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8cebeb32-2a0c-4be6-9dc1-df22a3af3a41 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.482194 Jul 15 14:01:42.333337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 42/85] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:41 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:42.350431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-6ce3280f-b817-4eb8-bb4e-995ed97b15b3 req-073bcec6-fb02-4785-aa0b-e1dfd8d3a4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a543a41-bbbc-4c3a-833a-903faa97dde7", "tag": "88f82e49-8214-4511-9860-93f14cc42d7e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:42.361030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-6ce3280f-b817-4eb8-bb4e-995ed97b15b3 req-073bcec6-fb02-4785-aa0b-e1dfd8d3a4ac service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.361670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-6ce3280f-b817-4eb8-bb4e-995ed97b15b3 req-073bcec6-fb02-4785-aa0b-e1dfd8d3a4ac service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.396119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-6ce3280f-b817-4eb8-bb4e-995ed97b15b3 req-073bcec6-fb02-4785-aa0b-e1dfd8d3a4ac service nova] Creating event network-changed:88f82e49-8214-4511-9860-93f14cc42d7e for instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 on hv-cinder-85000 Jul 15 14:01:42.408297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-6ce3280f-b817-4eb8-bb4e-995ed97b15b3 req-073bcec6-fb02-4785-aa0b-e1dfd8d3a4ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060756 Jul 15 14:01:42.409418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 44/86] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:01:42.530501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:42.531200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:42.538399 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.538841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.540061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.540792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.698912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:42.707356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-21414707-fe34-4598-a029-bbfacfc6395c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.180627 Jul 15 14:01:42.707936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:42 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:42.865914 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:42.866507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:42.873469 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.873920 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.874687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.875296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.907415 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:42.908848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:42.921480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.922464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:42.924045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:42.925060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:43.133495 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:43.145415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c8448b6e-9851-4221-ad16-c4cdc9f2cb7c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.283362 Jul 15 14:01:43.146293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:42 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:43.183662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:43.194347 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0d0e397c-f597-4ff8-9310-b152c57cbd58 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.294958 Jul 15 14:01:43.195255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:42 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:43.359933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:43.360788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:43.369795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:43.370378 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:43.371451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:43.372063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:43.552253 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:43.561778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:43.563492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:43.564585 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bef2b23c-3327-4884-9053-3fd07b21ca09 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.208751 Jul 15 14:01:43.565285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 46/90] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:43 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:43.737483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:43.740781 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:43.750978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:43.751429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:43.752202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:43.753426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.054477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.065440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-04fb2980-9888-48f6-9c0c-7c4294e683b0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.335020 Jul 15 14:01:44.066194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 45/91] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:43 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:44.171598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:44.173506 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:44.182229 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.182924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.184016 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.184655 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.213608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:44.214529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:44.222841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.226730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.227827 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.229564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.548881 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.560103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-611c3b36-c4ac-4c43-8e1f-7d05bdf7c1fb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.351315 Jul 15 14:01:44.561629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 46/92] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:44 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:44.583489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:44.585209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:44.592503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.593046 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.593882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:44.594542 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:44.598607 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.610935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-519f2b62-06d8-491b-87e1-2b910f62c0b0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.452030 Jul 15 14:01:44.611718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 47/93] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:44 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:44.638701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=100 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:44.823507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.839478 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.842174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:44.843761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-19df81d2-a721-4722-9488-248b6e52d165 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.264685 Jul 15 14:01:44.844667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 47/94] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:44 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:01:45.085623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:45.086431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:45.093835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.102957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.111927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.112424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.320088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:45.327376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3b92823b-5281-481b-94c5-52d45516d04b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.247160 Jul 15 14:01:45.328360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 48/95] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:45 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:45.582660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:45.584640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:45.594824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.595346 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.596715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.598046 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.629172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:45.629964 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:45.640874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.641319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.642221 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.642562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.935875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:45.937682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:45.945813 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-48c3ebb9-6eb8-408a-8100-121b6d44f795 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.320443 Jul 15 14:01:45.946413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 49/96] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:45 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:45.958136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:45.958746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:45.962903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-80d13804-6515-4f23-8bc7-0545e3dcbd65 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.386992 Jul 15 14:01:45.964184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 48/97] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:45 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:45.965773 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.966339 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:45.967231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:45.967785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:46.196861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:46.211195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:46.214804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:46.216823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-36691d2e-0ccb-4269-b0f9-6396d1f4b8c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.269089 Jul 15 14:01:46.217879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 50/98] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:45 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:46.345162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:46.345881 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:46.352334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:46.352824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:46.354346 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:46.354800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:46.530941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:46.544029 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9fddf492-da1f-4b0a-9feb-b71c5370b7aa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.202557 Jul 15 14:01:46.544927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:46 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:46.977395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:46.981643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:46.997153 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:47.001219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:47.019094 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.023090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.024156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.025180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.028430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.029712 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.030472 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.031483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.644488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:47.665527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-762f869a-4253-4ac1-bfa8-258e0fdbf9be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.675265 Jul 15 14:01:47.669178 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:46 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:47.678912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:47.680244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:47.683178 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:47.692723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:47.697658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.698727 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.701419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.702486 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.706275 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c0396056-fd7f-4f57-80e3-268b70cb1937 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.739205 Jul 15 14:01:47.708021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:46 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:47.729712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:47.730698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:47.750525 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.751260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:47.752667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:47.753429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:48.059067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:48.085747 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:48.087446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:48.096860 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2d5d2d4c-b407-41a0-bd21-cbbc64d7b2c2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.425714 Jul 15 14:01:48.114668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 51/102] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:47 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:48.118485 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:48.144635 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cb5d91d7-0c33-45de-8f1f-f425754006f2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.424460 Jul 15 14:01:48.145790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 52/103] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:47 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:48.687121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:48.687609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:48.696972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:48.698223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:48.699611 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:48.700202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:48.740534 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:48.742258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:48.754406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:48.754976 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:48.755879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:48.756498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:48.986667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.001401 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1d5eb5b3-77b4-4ee0-9c0b-bb9a89364883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.318581 Jul 15 14:01:49.002606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:48 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:49.002792 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.015406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-77a8cabd-7022-4615-8e2d-178fed5b4bb0 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.287054 Jul 15 14:01:49.016047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 53/105] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:48 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:49.118759 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:49.119922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:49.130680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:49.131571 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:49.132937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:49.133648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:49.166951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:49.168181 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:49.177303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:49.178074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:49.178874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:49.179497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:49.378984 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.389970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.393199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.394529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:49.395338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-604223c4-c521-4b39-bdf8-215f2dfac922 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.282493 Jul 15 14:01:49.396466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 53/106] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:49 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:49.404535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-05122f38-6d4c-4738-9e31-deb3b4f2a0b7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.245461 Jul 15 14:01:49.405225 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 54/107] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:49 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:50.023816 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:50.024890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:50.034553 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:50.035336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:50.036490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.037403 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.039201 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.039682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.043468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.044022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.044950 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.045536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.393514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.402629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.403479 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-87138aea-1153-4ad8-b10d-955c4911ca84 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.387085 Jul 15 14:01:50.403890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 54/108] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:50 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:50.411244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b2ef7e5c-7b76-4b32-94eb-032b7bb7ef17 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.381395 Jul 15 14:01:50.411844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 55/109] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:50 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:50.421804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:50.422947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:50.430411 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:50.431294 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:50.434553 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.435310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.437812 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.438259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.439022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.439449 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.439863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:50.440689 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:50.671910 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.682482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.684802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-76765deb-4e81-4a3e-af57-01874d381dbb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.258053 Jul 15 14:01:50.685788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 56/110] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:50 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:50.693926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.695556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:50.696746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f39005f3-81c8-4a02-be94-96b80146c24f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.282945 Jul 15 14:01:50.697410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 55/111] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:50 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:51.429911 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:51.430998 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:51.432762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:51.434718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:51.444337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:51.449534 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:51.450612 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:51.451293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:51.453070 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:51.453783 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:51.457143 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:51.459059 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:51.961997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:51.997222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-35e40624-ecc6-4cfe-b4f5-d784167f8ada tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.568331 Jul 15 14:01:52.017697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 57/112] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:51 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:52.041958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:52.044303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:52.076545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:52.077469 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:52.084457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:52.085374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:52.197402 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:52.222263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-be0bd3f3-60d6-482d-a28e-aa93c4720666 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.795880 Jul 15 14:01:52.236546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 56/113] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:51 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:52.250304 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:52.255778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:52.278413 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:52.283179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:52.285012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:52.285983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:52.516878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:52.532259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-21465a34-87d3-4202-9539-3c0384b107f9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.511575 Jul 15 14:01:52.535598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:52 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:52.633604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:52.644521 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-14b8b70a-c95c-47d5-8d6c-ba291cc5d4ba req-8981bdac-63e8-4d7c-8a20-f7fda93a188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6bc8f0-81aa-45df-9fb1-4e581cf0913e", "name": "network-vif-plugged", "status": "completed", "tag": "c7be0622-dca5-4205-98fa-99c86a79c041"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:52.646220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:52.648418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:52.650972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3f93faa2-b999-4aeb-aef9-0388e40c0061 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.411846 Jul 15 14:01:52.651860 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 57/115] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:52 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:52.654425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-14b8b70a-c95c-47d5-8d6c-ba291cc5d4ba req-8981bdac-63e8-4d7c-8a20-f7fda93a188f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:52.654918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-14b8b70a-c95c-47d5-8d6c-ba291cc5d4ba req-8981bdac-63e8-4d7c-8a20-f7fda93a188f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:52.668118 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-14b8b70a-c95c-47d5-8d6c-ba291cc5d4ba req-8981bdac-63e8-4d7c-8a20-f7fda93a188f service nova] Creating event network-vif-plugged:c7be0622-dca5-4205-98fa-99c86a79c041 for instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e on hv-cinder-85000 Jul 15 14:01:52.673846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-14b8b70a-c95c-47d5-8d6c-ba291cc5d4ba req-8981bdac-63e8-4d7c-8a20-f7fda93a188f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135083 Jul 15 14:01:52.674457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 59/116] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:53.031957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:53.032495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:53.039061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.039515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.040312 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.040774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.225979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:53.238613 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-036867eb-b273-4965-9e40-b4d5fafc2bc7 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.210607 Jul 15 14:01:53.239447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:53 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:53.251744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:53.252481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:53.259867 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.260311 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.261350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.261980 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.470050 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:53.499366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d52b2ab7-33b2-4052-9ab2-6c81c98ec6d9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.249035 Jul 15 14:01:53.500657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:53 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:53.557866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:53.559882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:53.582779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.585732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.587328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.589031 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.670217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:53.671431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:53.682487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.682942 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.683755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:53.684199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:53.987756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.000590 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-da5a71a7-3daf-405c-9da6-00db111ec33a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.449978 Jul 15 14:01:54.001648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:53 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:54.059329 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.073119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.076296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.078400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bfe0bd88-28f8-4052-ae3d-a7301db0949a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.412726 Jul 15 14:01:54.079377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 61/120] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:53 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:54.263066 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:54.264002 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:54.275966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:54.276786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:54.278186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:54.278927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:54.531458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:54.532597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:54.538863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.546408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:54.547523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:54.548948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:54.550028 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:54.553554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6cbe1db9-e8ca-4aa6-885e-e4e1d3d10aeb tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.297370 Jul 15 14:01:54.554556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:54 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:54.693814 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-b8d9188c-39ad-42e9-9343-56f2ba16c1c7 req-2a018fa9-990d-4a13-9977-4b11199faeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c49059-61d4-4969-96dc-a92d8f3d4cb9", "name": "network-vif-plugged", "status": "completed", "tag": "d7c665a6-0206-4af0-9832-e67d770dfcea"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:54.708626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b8d9188c-39ad-42e9-9343-56f2ba16c1c7 req-2a018fa9-990d-4a13-9977-4b11199faeee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:54.709454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b8d9188c-39ad-42e9-9343-56f2ba16c1c7 req-2a018fa9-990d-4a13-9977-4b11199faeee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:54.729630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-b8d9188c-39ad-42e9-9343-56f2ba16c1c7 req-2a018fa9-990d-4a13-9977-4b11199faeee service nova] Creating event network-vif-plugged:d7c665a6-0206-4af0-9832-e67d770dfcea for instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 on hv-cinder-85000 Jul 15 14:01:54.738919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-b8d9188c-39ad-42e9-9343-56f2ba16c1c7 req-2a018fa9-990d-4a13-9977-4b11199faeee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051409 Jul 15 14:01:54.740070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 61/122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:54.814340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:54.826160 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e2198131-9bea-43bc-bc52-a8a7b6274847 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.303004 Jul 15 14:01:54.827161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:54 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:01:55.026367 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:55.027429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:55.029896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=77 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:55.037087 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.037822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.038723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.039235 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.129199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:55.134067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:55.148827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.152605 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.155440 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.156598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.272179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:55.284983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0a4b3326-8aa7-4ccc-a94e-df6e48eef8c7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.263809 Jul 15 14:01:55.292178 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 62/124] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:55 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:55.378573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:55.389386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:55.391366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:55.392904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1f8851ae-dc2e-4646-b47a-67a16c85669b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.274241 Jul 15 14:01:55.403898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 63/125] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:55 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:55.574117 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:55.575132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:55.584122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.585232 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.586336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.587135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.803355 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:55.813806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-adeb6aa4-91bd-476a-b506-9d05b550d9ef tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.245737 Jul 15 14:01:55.814468 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 63/126] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:55 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:55.851992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:55.852861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:55.861236 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.862001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:55.863025 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:55.863781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:56.072672 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:56.083676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0bebf761-fde6-42ee-9962-847e3c11ac2e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.235669 Jul 15 14:01:56.084610 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 64/127] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:55 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:56.316681 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:56.317965 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:56.328700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:56.329494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:56.330835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:56.331618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:56.418455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:56.419677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:56.447887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:56.449467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:56.455414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:56.459442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:56.890818 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:56.908320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=100 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:56.944433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-83664db6-8718-4cdf-ad22-d58d6f013277 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.634725 Jul 15 14:01:56.968726 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 64/128] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:56 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:56.996616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:56.997778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:57.034849 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:57.035634 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:57.047558 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:57.048416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:57.079128 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:57.122018 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:57.125327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:57.127577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-27e403ea-cd66-4816-bc70-9ef2a2070e7f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.717371 Jul 15 14:01:57.128652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 65/129] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:56 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:57.163230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:57.167279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:57.191390 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:57.192894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:57.195587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:57.197183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:57.622981 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:57.637610 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b8c8b57b-3e6a-4a82-91f4-7d7ae54e5f3e tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.664737 Jul 15 14:01:57.638527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 65/130] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:56 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:57.643549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:57.652688 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c6d5b399-20c5-48a5-a5c6-0ed4c2eb9f72 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.517331 Jul 15 14:01:57.656765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 66/131] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:57 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:57.992563 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:57.994142 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:58.021732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.022272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.024409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.026368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.169069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:58.170173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:58.200919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.213753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.215374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.216032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.264191 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:58.277190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c79eb8f4-ca7d-4132-bd4f-5231f6b1736f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.290803 Jul 15 14:01:58.287562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 66/132] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:57 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:58.472614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:58.483391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:58.485720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:58.487382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bea6af8c-1617-464a-86e9-d0ae8d0b7e63 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.325222 Jul 15 14:01:58.488734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 67/133] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:58 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:01:58.668277 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:58.669426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:58.680011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:58.680772 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.682180 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:58.682304 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.683706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.684510 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.690429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.691219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.694180 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:58.694923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:58.975185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:58.990151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-41b68000-6a1b-4b5b-b32f-e40d1b2b2404 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.314310 Jul 15 14:01:58.992105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:58 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:59.003424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:59.014981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-0081f4fd-c653-4d95-a1ad-0c396e1236c0 req-d5e4c2c1-d83b-440b-8e53-8b63b8a23668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "name": "network-vif-plugged", "status": "completed", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:01:59.027835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0081f4fd-c653-4d95-a1ad-0c396e1236c0 req-d5e4c2c1-d83b-440b-8e53-8b63b8a23668 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:59.030221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-52eeb1e0-07af-4745-987b-327115e28bdd tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.370515 Jul 15 14:01:59.031245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:58 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:59.032488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0081f4fd-c653-4d95-a1ad-0c396e1236c0 req-d5e4c2c1-d83b-440b-8e53-8b63b8a23668 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:59.038166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:01:59.054950 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-0081f4fd-c653-4d95-a1ad-0c396e1236c0 req-d5e4c2c1-d83b-440b-8e53-8b63b8a23668 service nova] Creating event network-vif-plugged:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:01:59.064901 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-0081f4fd-c653-4d95-a1ad-0c396e1236c0 req-d5e4c2c1-d83b-440b-8e53-8b63b8a23668 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070269 Jul 15 14:01:59.065946 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 69/136] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:01:59.298292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:59.299722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:59.327467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:59.328083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:59.329693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:59.330433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:59.539619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:01:59.541936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:01:59.566943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:59.567697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:59.572779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:01:59.575116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:01:59.591320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:59.600441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-dee4b5e7-64a1-41c2-91ac-0b7286defa05 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.307499 Jul 15 14:01:59.601039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 68/137] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:01:59 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:01:59.802632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:59.823715 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:59.827105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:01:59.829436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-053d1066-e19b-4ef0-99ee-dcaa173069dc tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.315912 Jul 15 14:01:59.844445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 70/138] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:01:59 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:02:00.020780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:00.021706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:00.032144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.032926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.034234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.034952 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.051591 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:00.052664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:00.067114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.068765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.069715 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.070254 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.325002 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:00.334034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:00.335013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1ce11811-3e42-4ee9-a7e7-a5ef51b01073 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.319553 Jul 15 14:02:00.335606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:00 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:00.367886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-36bad91b-56bc-4498-94c2-72607872397b tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.322269 Jul 15 14:02:00.370053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 71/140] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:00 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:00.619102 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:00.619907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:00.626579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.627022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.627817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.628252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.783491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:00.791828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f4730a67-d41a-4b5c-b53b-ebbe65ea5922 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.176714 Jul 15 14:02:00.792445 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:00 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:00.860336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:00.860997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:00.867929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.868483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:00.869966 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:00.870380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.088963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-74b6a38b-f4f7-468c-9873-e78d1ad9c8d7 req-82090484-ff35-47eb-8b51-b52f22614b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bc879c-c169-47cb-a214-86d5850a55ec", "name": "network-vif-plugged", "status": "completed", "tag": "0861b4f1-fb2d-42f9-b72b-e415301f1546"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:01.103710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-74b6a38b-f4f7-468c-9873-e78d1ad9c8d7 req-82090484-ff35-47eb-8b51-b52f22614b56 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.104220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-74b6a38b-f4f7-468c-9873-e78d1ad9c8d7 req-82090484-ff35-47eb-8b51-b52f22614b56 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.128459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-74b6a38b-f4f7-468c-9873-e78d1ad9c8d7 req-82090484-ff35-47eb-8b51-b52f22614b56 service nova] Creating event network-vif-plugged:0861b4f1-fb2d-42f9-b72b-e415301f1546 for instance 89bc879c-c169-47cb-a214-86d5850a55ec on hv-cinder-85000 Jul 15 14:02:01.135865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-74b6a38b-f4f7-468c-9873-e78d1ad9c8d7 req-82090484-ff35-47eb-8b51-b52f22614b56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057440 Jul 15 14:02:01.136743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 71/142] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:02:01.216950 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:01.226112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:01.227666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:01.228875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-36850a12-7069-47a9-8d60-781f4329478e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.372884 Jul 15 14:02:01.229458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 72/143] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:02:00 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:02:01.365485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:01.366189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:01.372988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.373434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.374213 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.374696 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.396484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:01.397558 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:01.408743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.409468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.410731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.411406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.633646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:01.644337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0b0d1af6-1f45-45f6-a6c3-5e1f1e7b671b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.283112 Jul 15 14:02:01.645151 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 72/144] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:01 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:01.653849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:01.667500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f5db0cb4-b56b-430f-bbe6-12c6f293fc6f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.277663 Jul 15 14:02:01.668526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 73/145] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:01 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:01.813856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:01.815345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:01.827236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.828375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:01.830033 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:01.830970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.032042 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:02.046768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e5da6383-6abd-4784-9628-5882cdd10cde tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.240391 Jul 15 14:02:02.048190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 73/146] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:01 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:02.262488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:02.267740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:02.303652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.305013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.313726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.314605 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.557211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:02.570917 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:02.574026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:02.575433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0676d2b2-7db2-4e94-892b-f2b1b66f2633 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.319314 Jul 15 14:02:02.576228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 74/147] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:02:02 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:02:02.678260 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:02.678260 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:02.691186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:02.693948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:02.704018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.709444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.711241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.713880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.721368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.722228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:02.723630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:02.724373 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.093113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.096587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.103661 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-331f4105-9fa0-4ffd-9c94-2b855e3f8063 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1315 microversion: 2.1 time: 0.418522 Jul 15 14:02:03.105159 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-17d1520b-2553-47d2-9915-ae9321a687e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.435070 Jul 15 14:02:03.105740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 74/148] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:02 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:03.114733 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 75/149] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:02 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:03.114956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:03.115540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:03.123922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:03.124770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.126008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:03.127024 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.174041 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-33da5348-13ef-41eb-a2f2-86d88ff332ce req-8573330e-d96b-40bb-a689-174bfd561d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a543a41-bbbc-4c3a-833a-903faa97dde7", "name": "network-vif-plugged", "status": "completed", "tag": "88f82e49-8214-4511-9860-93f14cc42d7e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:03.179292 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=92 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:03.196302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-33da5348-13ef-41eb-a2f2-86d88ff332ce req-8573330e-d96b-40bb-a689-174bfd561d72 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:03.199914 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-33da5348-13ef-41eb-a2f2-86d88ff332ce req-8573330e-d96b-40bb-a689-174bfd561d72 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.218994 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-33da5348-13ef-41eb-a2f2-86d88ff332ce req-8573330e-d96b-40bb-a689-174bfd561d72 service nova] Creating event network-vif-plugged:88f82e49-8214-4511-9860-93f14cc42d7e for instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 on hv-cinder-85000 Jul 15 14:02:03.225150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-33da5348-13ef-41eb-a2f2-86d88ff332ce req-8573330e-d96b-40bb-a689-174bfd561d72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057568 Jul 15 14:02:03.225942 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 76/150] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:02:03.376097 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.385868 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5276ee9a-44f9-49ee-9b9b-acb240e120c4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.277077 Jul 15 14:02:03.386500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:03 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:03.595840 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:03.597546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:03.607065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:03.607545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.608839 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:03.609047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:03.828968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.844093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.847094 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:03.849284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2df7b42e-ae71-4b79-a1f8-2f1bc212b80d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1407 microversion: 2.20 time: 0.258888 Jul 15 14:02:03.850301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 77/152] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:02:03 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:02:04.125791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:04.126986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:04.134876 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:04.135972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:04.136734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.137461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.138986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.139709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.143109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.143790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.144831 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.145717 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.377252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:04.396431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b8a51d46-32b9-4c02-b08c-10dbb30797bc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1502 microversion: 2.1 time: 0.276920 Jul 15 14:02:04.398910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:04 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:04.414924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:04.417758 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:04.419212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:04.432414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c65606fe-8a59-4785-aaf1-e269733cbfc1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.300300 Jul 15 14:02:04.437754 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:04 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:04.447942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.453431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.454551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.455358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.716884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:04.730525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-24e092d0-eba8-4018-a573-124e1ec63c5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1321 microversion: 2.1 time: 0.320356 Jul 15 14:02:04.732127 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:04 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:04.873457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:04.877456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:04.895219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.897191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:04.900470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:04.902018 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.319643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:05.331274 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:05.333030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:05.334958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f1f2ca99-d89c-424b-9902-7faf5aa9629d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1598 microversion: 2.20 time: 0.469116 Jul 15 14:02:05.335874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 79/156] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:02:04 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1598 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:02:05.355835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:05.356785 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:05.368733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.370465 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.373373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.375204 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.460333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:05.461270 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:05.471687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.473956 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.477421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.478931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.659322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-786a10a9-1196-470c-b2ec-7f2fce0fb308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.308652 Jul 15 14:02:05.660504 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 78/157] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jul 15 14:02:05 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:02:05.738499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:05.749975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3f418c96-6504-4cdf-bdc9-52dfd54243e1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.297513 Jul 15 14:02:05.757584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:05.758608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:05.761923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:05 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:05.766835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.768657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.769524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.770081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.917647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:05.926298 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e5905a02-cf52-4b7b-88e2-8b4debd3ed39 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1514 microversion: 2.1 time: 0.172889 Jul 15 14:02:05.927176 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:05 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:05.953952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:05.955365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:05.962908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.963482 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:05.964437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:05.965035 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.046900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lazy-loading 'flavor' on Instance uuid 89bc879c-c169-47cb-a214-86d5850a55ec {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:02:06.318389 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e9ad744c-0488-497d-8823-8d4caad4789d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec/action" status: 200 len: 32 microversion: 2.1 time: 0.368635 Jul 15 14:02:06.340579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 81/160] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:02:05 2022] POST /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:02:06.340828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:06.342122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:06.356091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.358444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.360122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.361989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.430457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc5e419-cad6-4131-8f0d-e8a62b02ec23"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:06.434062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:06.444570 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.445516 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.447731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.448620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.652983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:06.685779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-162ec5a8-bf52-4992-9d39-0c0b3e74c5f5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.356821 Jul 15 14:02:06.686400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:06 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:06.771725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:06.772826 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:06.833828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.837493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:06.839099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:06.850350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:07.120690 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-93291c13-09e3-4a5c-8b97-eddd1f9b9d70 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "POST /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693135 Jul 15 14:02:07.129783 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 82/162] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:02:06 2022] POST /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:02:07.258723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:07.274140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-65a6c889-15f5-47c2-98c6-f1c4495890a7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.508501 Jul 15 14:02:07.284617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:06 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:07.715217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:07.715887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:07.724673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:07.725595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:07.726707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:07.727457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:08.147405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:08.166786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:08.197619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d6ff0064-ce9c-49dc-a69b-542ea6e6732d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.486887 Jul 15 14:02:08.199045 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:07 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:08.308380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:08.308380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:08.318362 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:08.321063 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:08.324445 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:08.328739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:08.394774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=100 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:08.719646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:08.746179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8791f132-8b2a-4fef-8ee3-74bcb73c96ae tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1363 microversion: 2.1 time: 0.445564 Jul 15 14:02:08.747214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:08 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:08.875509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-b95da105-5ad7-4b47-8e9e-0fca58eef3e2 req-a967d37e-613b-48b4-add1-1fe65718ec0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:08.889800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b95da105-5ad7-4b47-8e9e-0fca58eef3e2 req-a967d37e-613b-48b4-add1-1fe65718ec0b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:08.890667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b95da105-5ad7-4b47-8e9e-0fca58eef3e2 req-a967d37e-613b-48b4-add1-1fe65718ec0b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:08.907721 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-b95da105-5ad7-4b47-8e9e-0fca58eef3e2 req-a967d37e-613b-48b4-add1-1fe65718ec0b service nova] Creating event network-changed:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:02:08.914828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-b95da105-5ad7-4b47-8e9e-0fca58eef3e2 req-a967d37e-613b-48b4-add1-1fe65718ec0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046320 Jul 15 14:02:08.917028 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 84/166] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:02:09.219961 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:09.237662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:09.266951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:09.267660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:09.273533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:09.274160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:09.788616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:09.792331 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:09.815525 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:09.816544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:09.818049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:09.818984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:09.851896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:09.879640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-852a9d4f-1a70-4848-9f56-d1b47d0d3ffe tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.666849 Jul 15 14:02:09.896822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:09 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:10.368101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:10.380600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e4092ceb-5ac0-4c15-b83f-715c213ef922 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1548 microversion: 2.1 time: 0.604335 Jul 15 14:02:10.382250 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:09 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1548 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:10.418516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:10.418990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:10.427615 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:10.428657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:10.429934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:10.432150 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:10.751189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6bc4ee50-bb72-4da2-9c70-a70f7536e884 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338668 Jul 15 14:02:10.752661 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:02:10 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:02:10.909972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:10.910595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:10.927103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:10.927612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:10.928716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:10.929167 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:11.338641 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:11.363844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c47c27ee-b677-4857-b9f7-47a81223ba4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.458141 Jul 15 14:02:11.383909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:10 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:12.396811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:12.398055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:12.425106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:12.426973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:12.432714 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:12.433707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:12.908571 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:12.933935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d95cf165-3307-47a2-9652-1bbbcf52b8b5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.543114 Jul 15 14:02:12.934775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 85/171] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:12 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:13.331285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-f8e1ea52-8729-44ec-b815-1ae574676367 req-bc84f519-c172-4f5a-a40e-a5e8d8ffb07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a543a41-bbbc-4c3a-833a-903faa97dde7", "tag": "88f82e49-8214-4511-9860-93f14cc42d7e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:13.350985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f8e1ea52-8729-44ec-b815-1ae574676367 req-bc84f519-c172-4f5a-a40e-a5e8d8ffb07d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:13.352335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f8e1ea52-8729-44ec-b815-1ae574676367 req-bc84f519-c172-4f5a-a40e-a5e8d8ffb07d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:13.378133 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-f8e1ea52-8729-44ec-b815-1ae574676367 req-bc84f519-c172-4f5a-a40e-a5e8d8ffb07d service nova] Creating event network-changed:88f82e49-8214-4511-9860-93f14cc42d7e for instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 on hv-cinder-85000 Jul 15 14:02:13.394052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-f8e1ea52-8729-44ec-b815-1ae574676367 req-bc84f519-c172-4f5a-a40e-a5e8d8ffb07d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068946 Jul 15 14:02:13.401834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 87/172] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:02:13.965055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:13.969666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:14.020753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:14.030227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:14.036739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:14.037877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:14.616170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:14.640794 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1a469663-b4fd-475b-8834-01e622a7c939 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.683950 Jul 15 14:02:14.659641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 86/173] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:13 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:15.680037 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:15.682530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:15.746093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:15.753188 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:15.759524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:15.763945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:16.335523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:16.359744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3506c50f-d62c-4777-b738-f28d8e913e16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.688009 Jul 15 14:02:16.361114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 88/174] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:15 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:17.393921 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:17.394947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:17.410825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.411826 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:17.413252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.414244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:17.636371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:17.637283 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:17.653150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.653150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:17.653150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.653150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:17.702940 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:02:17.733937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:17.749557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e830d3a5-4134-4d37-b5ac-f25646c06c4b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.361357 Jul 15 14:02:17.751276 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 87/175] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:17 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:17.856243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-16b6c3c2-0f9f-47d7-b667-07c1fb74e4dc tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 204 len: 0 microversion: 2.1 time: 0.226971 Jul 15 14:02:17.858365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 89/176] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:02:17 2022] DELETE /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:02:17.869531 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:17.870896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:17.878917 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.879876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:17.881062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:17.881747 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:18.135870 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:18.149693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-177ba643-79bb-4fdc-b205-b0b945894a19 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1554 microversion: 2.1 time: 0.285843 Jul 15 14:02:18.150918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 88/177] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:17 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:18.797461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:18.800679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:18.819079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:18.822032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:18.823413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:18.824445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:19.077565 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:19.089133 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fac9b653-b4d7-4798-a23a-962dd4e3dc63 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.314573 Jul 15 14:02:19.090194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 90/178] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:18 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:19.184007 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:19.187387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:19.210499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:19.212572 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:19.214920 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:19.215760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:19.611076 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:19.633215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0975c634-1d03-45cc-9f79-551e767a3392 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1554 microversion: 2.1 time: 0.457065 Jul 15 14:02:19.636254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 89/179] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:19 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1554 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:20.120280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:20.121154 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:20.130520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:20.130993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:20.131887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:20.132340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:20.433821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:20.450742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bebff362-7b91-4b5e-a295-a0baf7e3aba7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.334252 Jul 15 14:02:20.452476 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:20 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:20.681441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:20.683642 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:20.717424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:20.718528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:20.720251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:20.721612 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:21.094070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:21.115382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fee13136-d6ce-4d0f-b529-9f6aaee88866 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1554 microversion: 2.1 time: 0.451453 Jul 15 14:02:21.117118 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 90/181] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:20 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1554 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:21.476969 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:21.477844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:21.494014 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:21.495806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:21.498986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:21.499938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:21.879024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:21.899237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-359cd99b-3c4a-458c-908b-52a99553e4ac tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.426644 Jul 15 14:02:21.901173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 92/182] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:21 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:22.135179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-eee5fe14-185b-4d50-9a44-d1a05652f312 req-aa2e95d0-bca3-4c2b-838b-e5c280512d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c49059-61d4-4969-96dc-a92d8f3d4cb9", "name": "network-vif-deleted", "tag": "d7c665a6-0206-4af0-9832-e67d770dfcea"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:22.143927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:22.144613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:22.159399 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:22.159756 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:22.164005 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:22.164483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:22.166922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-eee5fe14-185b-4d50-9a44-d1a05652f312 req-aa2e95d0-bca3-4c2b-838b-e5c280512d48 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:22.172276 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-eee5fe14-185b-4d50-9a44-d1a05652f312 req-aa2e95d0-bca3-4c2b-838b-e5c280512d48 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:22.208797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-eee5fe14-185b-4d50-9a44-d1a05652f312 req-aa2e95d0-bca3-4c2b-838b-e5c280512d48 service nova] Creating event network-vif-deleted:d7c665a6-0206-4af0-9832-e67d770dfcea for instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 on hv-cinder-85000 Jul 15 14:02:22.219745 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-eee5fe14-185b-4d50-9a44-d1a05652f312 req-aa2e95d0-bca3-4c2b-838b-e5c280512d48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088421 Jul 15 14:02:22.229954 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 91/183] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:02:22.325437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:22.337072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8418d43a-fedf-4c08-ba4b-d9b131e8f626 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1512 microversion: 2.1 time: 0.196913 Jul 15 14:02:22.338111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 93/184] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:22 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:22.927692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:22.928461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:22.935952 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:22.936434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:22.937204 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:22.937625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:23.129609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:23.154352 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b19ad5a1-53e8-4675-9755-33712bf7cda8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.230922 Jul 15 14:02:23.176603 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 92/185] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:22 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:23.356704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:23.357905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:23.370463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:23.371337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:23.372498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:23.373230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:23.461810 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:23.476609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7e2b0091-f006-404f-9229-c4744870351c tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1346 microversion: 2.1 time: 0.125039 Jul 15 14:02:23.478161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:23 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:24.183799 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:24.184641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:24.191311 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:24.191760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:24.192602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:24.193042 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:24.410421 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:24.423058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8dd4c0e8-b73c-46a4-9fba-d8c2d49f7129 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.243613 Jul 15 14:02:24.423762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 93/187] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:24 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:24.497745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:24.498467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:24.506987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:24.507639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:24.508647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:24.509707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:24.596184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:24.607401 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6d577a36-d45e-44a8-b14d-390c55a8c56f tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1346 microversion: 2.1 time: 0.114778 Jul 15 14:02:24.608084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 95/188] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:24 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:25.451202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:25.452086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:25.475994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=64 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:25.482184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:25.483715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:25.485406 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:25.487056 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:25.629103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:25.629898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:25.646324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:25.646807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:25.647841 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:25.648880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:25.733071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:25.733637 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:25.734398 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lazy-loading 'fault' on Instance uuid 03c49059-61d4-4969-96dc-a92d8f3d4cb9 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:02:25.853522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:25.882294 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:25.887451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-24f7f13f-4d06-4121-bad2-2daceb0df28d tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1351 microversion: 2.1 time: 0.262919 Jul 15 14:02:25.888786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 96/189] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:25 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1351 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:25.914342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7ce04635-61ea-4654-a8b2-01fa1e4d023b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.473094 Jul 15 14:02:25.915725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 94/190] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:25 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:26.924093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:26.926156 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:26.946806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:26.949164 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:26.960445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:26.961197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:26.962950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:26.963765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:26.963935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:26.964953 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:26.965297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:26.966077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:27.028058 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:27.028728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:27.029300 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lazy-loading 'fault' on Instance uuid 03c49059-61d4-4969-96dc-a92d8f3d4cb9 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:02:27.141540 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:27.154853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e9e1a239-0e4c-4327-be36-051618d84b41 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1351 microversion: 2.1 time: 0.240590 Jul 15 14:02:27.155461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 97/191] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:26 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:27.257399 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:27.267225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d2f5931c-7e6e-4e77-a6f5-88a15c58ca93 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.329403 Jul 15 14:02:27.268299 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 95/192] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:26 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:28.176718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:28.177632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:28.185238 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:28.185694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:28.186492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:28.186928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:28.230344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:28.231062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:28.232047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lazy-loading 'fault' on Instance uuid 03c49059-61d4-4969-96dc-a92d8f3d4cb9 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:02:28.294513 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e70b3794a445fc8deeb5f967eef673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c9ca821cd341a98f21ca15a0d6eb4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:28.300205 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:28.302829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:28.312989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-92ecbbba-da4b-4e9b-9a48-7c306f111218 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 200 len: 1351 microversion: 2.1 time: 0.141135 Jul 15 14:02:28.314387 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 98/193] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:28 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 1351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:28.315671 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:28.316798 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:28.318185 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:28.319187 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:28.610583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:28.622406 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-18dea52c-9853-42d6-9e81-fb5db2f44c16 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.330991 Jul 15 14:02:28.625579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 96/194] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:28 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:29.347016 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:29.349518 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:29.364073 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.365246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.367219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.369312 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.375874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:29.392516 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] HTTP exception thrown: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Request method failure captured: Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 HTTP/1.1 Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMlKDl21--h41hf8DOf9G3mMVVFELHzJqYlVONv6P3s6PqjcyEI3-69FUwDUvvtY0gUg-4IDtA3s4ylxhBUmrNvhECkW3XIQrmivQxqoPmLkIZZPpN46cpUc0SIpZG_Xvs-WbfZlBKmOFScYmQqunSjp2smP9qyB0wz7_bsj_LbeeY Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:02:29.398870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3c9ca821cd341a98f21ca15a0d6eb4c"}]}] Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 13e70b3794a445fc8deeb5f967eef673 Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.401622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '03c49059-61d4-4969-96dc-a92d8f3d4cb9'} Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:02:29.403029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.405659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.407666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Returning 404 to user: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:02:29.407666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-977b1253-e735-4e12-bb97-75b4f9f67dea tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 404 len: 111 microversion: 2.1 time: 0.063037 Jul 15 14:02:29.407666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 99/195] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:29 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:02:29.587931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:29.590296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:29.603655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.605286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.607224 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.608000 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.632695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] HTTP exception thrown: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Request method failure captured: Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9/os-volume_attachments HTTP/1.1 Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMlKDl21--h41hf8DOf9G3mMVVFELHzJqYlVONv6P3s6PqjcyEI3-69FUwDUvvtY0gUg-4IDtA3s4ylxhBUmrNvhECkW3XIQrmivQxqoPmLkIZZPpN46cpUc0SIpZG_Xvs-WbfZlBKmOFScYmQqunSjp2smP9qyB0wz7_bsj_LbeeY Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:02:29.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3c9ca821cd341a98f21ca15a0d6eb4c"}]}] Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 13e70b3794a445fc8deeb5f967eef673 Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.643680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'server_id': '03c49059-61d4-4969-96dc-a92d8f3d4cb9'} Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:02:29.644507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:29.646197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:29.647300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Returning 404 to user: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:02:29.647300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-72464519-3f96-4b01-98a0-8930f54eda88 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065875 Jul 15 14:02:29.647300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 97/196] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:02:29 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:02:29.655251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:29.656467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:29.672769 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.673240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.674303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:29.675371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:29.990217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:30.013069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b2a438d5-f6a4-46de-8f22-c3487e9764f3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.373120 Jul 15 14:02:30.015104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 100/197] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:29 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:30.999442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:31.000130 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:31.007098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.007551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.008311 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.009135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.025381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] HTTP exception thrown: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Request method failure captured: Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 HTTP/1.1 Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMlKDl21--h41hf8DOf9G3mMVVFELHzJqYlVONv6P3s6PqjcyEI3-69FUwDUvvtY0gUg-4IDtA3s4ylxhBUmrNvhECkW3XIQrmivQxqoPmLkIZZPpN46cpUc0SIpZG_Xvs-WbfZlBKmOFScYmQqunSjp2smP9qyB0wz7_bsj_LbeeY Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:02:31.028043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3c9ca821cd341a98f21ca15a0d6eb4c"}]}] Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 13e70b3794a445fc8deeb5f967eef673 Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.030378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '03c49059-61d4-4969-96dc-a92d8f3d4cb9'} Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:02:31.031543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.037604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.042247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Returning 404 to user: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:02:31.042247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-29c390e0-9fa7-4c52-a735-29e498c51a5a tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 404 len: 111 microversion: 2.1 time: 0.034431 Jul 15 14:02:31.042247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 98/198] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:02:30 2022] DELETE /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:02:31.045008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:31.045621 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] [instance: 03c49059-61d4-4969-96dc-a92d8f3d4cb9] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:31.050759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:31.052103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:31.058344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.058803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.059606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.060165 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.066376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.067501 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.069134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:31.069957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:31.076955 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] HTTP exception thrown: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Request method failure captured: Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 HTTP/1.1 Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMlKDl21--h41hf8DOf9G3mMVVFELHzJqYlVONv6P3s6PqjcyEI3-69FUwDUvvtY0gUg-4IDtA3s4ylxhBUmrNvhECkW3XIQrmivQxqoPmLkIZZPpN46cpUc0SIpZG_Xvs-WbfZlBKmOFScYmQqunSjp2smP9qyB0wz7_bsj_LbeeY Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:02:31.078499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3c9ca821cd341a98f21ca15a0d6eb4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3c9ca821cd341a98f21ca15a0d6eb4c"}]}] Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: d3c9ca821cd341a98f21ca15a0d6eb4c Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-DeleteServersTestJSON-452616049 Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 13e70b3794a445fc8deeb5f967eef673 Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-DeleteServersTestJSON-452616049-project Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.079675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '03c49059-61d4-4969-96dc-a92d8f3d4cb9'} Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:02:31.080377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. Jul 15 14:02:31.082668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:02:31.084179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] Returning 404 to user: Instance 03c49059-61d4-4969-96dc-a92d8f3d4cb9 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:02:31.084493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-26b96a0e-9823-4b99-a640-10e9bf35a7b6 tempest-DeleteServersTestJSON-452616049 tempest-DeleteServersTestJSON-452616049-project] 10.222.0.16 "GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9" status: 404 len: 111 microversion: 2.1 time: 0.043694 Jul 15 14:02:31.085280 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 99/199] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:31 2022] GET /compute/v2.1/servers/03c49059-61d4-4969-96dc-a92d8f3d4cb9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:02:31.564777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:31.577445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f0f13ee7-1ffb-48ba-9211-98da9a002854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.533830 Jul 15 14:02:31.588902 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 101/200] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:31 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:32.595937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:32.596770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:32.607443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:32.608773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:32.609922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:32.610536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:33.022045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:33.036334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fb4de45b-903a-4260-ab06-beaa5f4f173e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.443992 Jul 15 14:02:33.037307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 100/201] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:32 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:34.065008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:34.066444 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:34.073763 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:34.076538 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:34.077685 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:34.078985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:34.079609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:34.423808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:34.434664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bf3e02b3-3fdf-485f-a4f4-3860a2f03883 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.374630 Jul 15 14:02:34.437309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:34 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:35.478668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:35.486668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:35.501251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:35.502493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:35.504158 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:35.505776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:36.233279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:36.250470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-28ee2513-24c7-40a3-9db5-c7baae7a6f83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.774656 Jul 15 14:02:36.250470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:35 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:37.266101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:37.268151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:37.282931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:37.284296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:37.286718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:37.287607 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:37.721191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:37.735247 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7bd45562-3325-487f-857a-903dca705d0d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.476105 Jul 15 14:02:37.738190 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 103/204] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:37 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:38.781768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:38.782953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:38.822180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:38.822564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:38.825039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:38.826000 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:38.837388 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=99 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:39.390946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:39.405713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9b5206e1-d533-4c61-804d-ea21fe379612 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.648161 Jul 15 14:02:39.418226 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 102/205] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:38 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:40.428725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:40.430071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:40.447583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:40.448612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:40.449614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:40.450270 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:40.689566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:40.703164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7e271981-1f8a-4230-a2d7-d6647a0328dd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.278276 Jul 15 14:02:40.703761 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:40 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:41.724193 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:41.724841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:41.738312 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:41.738765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:41.739549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:41.739989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:42.007838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:42.021505 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a9c3b83d-2d98-4eeb-a8b9-3668f65e0182 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.301655 Jul 15 14:02:42.034220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 103/207] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:41 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:43.045429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:43.047264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:43.059617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:43.060638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:43.062450 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:43.063284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:43.317072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:43.329628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7f9881cf-4a91-4746-abcf-ac847c15f95a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1520 microversion: 2.1 time: 0.291504 Jul 15 14:02:43.330562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 105/208] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:43 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:44.360306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:44.363592 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:44.376481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:44.377626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:44.379695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:44.380843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:44.704099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:44.713838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4ba2c9e1-93d3-46e6-be51-5807c54bf0d2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1500 microversion: 2.1 time: 0.361641 Jul 15 14:02:44.714846 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 104/209] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:44 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1500 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:44.743760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:44.745993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:44.761116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:44.762117 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:44.763992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:44.765264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:44.974544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:44.991431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-591a7a27-998d-4a8a-8174-611eb61446df tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1514 microversion: 2.1 time: 0.255900 Jul 15 14:02:44.992982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:44 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:46.745111 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:02:46.746117 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:46.753383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:46.753815 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:46.755117 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:46.755401 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:46.797880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lazy-loading 'flavor' on Instance uuid 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:02:47.100706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-632c1214-3991-41f5-97fc-35412faaf284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/action" status: 200 len: 32 microversion: 2.1 time: 0.360140 Jul 15 14:02:47.101847 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 105/211] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:02:46 2022] POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:02:47.131397 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:47.132634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:47.153926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:47.154941 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:47.168044 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:47.172115 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:47.469246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:47.485090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7c1d4c8b-6132-4c00-96d8-6124fad9f4e9 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.373819 Jul 15 14:02:47.486306 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:47 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:48.514803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:48.516452 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:48.523676 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:48.525374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:48.526527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:48.527284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:48.698317 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:48.708872 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8af7249f-cd96-4433-acd5-16c23fe14682 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.198338 Jul 15 14:02:48.710122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 106/213] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:48 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:49.741219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:49.743766 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:49.754331 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:49.755075 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:49.756599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:49.757284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:50.011977 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:50.021952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-564e0d39-b156-490c-9616-637f41394342 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.287519 Jul 15 14:02:50.022567 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:49 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:51.051336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:51.052667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:51.064580 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:51.065386 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:51.066630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:51.067701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:51.260723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:51.270458 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f72401c5-2215-4ffd-8fce-5bb0a6138aaa tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.225718 Jul 15 14:02:51.271812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:51 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:52.298989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:52.302222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:52.312663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:52.314076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:52.315620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:52.316350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:52.588145 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:52.602590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2bdad3e7-0646-447d-ae1d-1cd405202a98 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.310866 Jul 15 14:02:52.603882 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:52 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:53.627208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:53.628346 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:53.635217 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:53.635655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:53.636688 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:53.637123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:53.802828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:53.812956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e0248849-c0b6-4a51-b339-d50dee331bf6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.189765 Jul 15 14:02:53.813960 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 108/217] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:53 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:54.849608 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:54.852747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:54.869141 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:54.870510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:54.873420 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:54.874737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:55.196827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:55.221635 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-064edc8b-60df-4c64-b353-5e337c8848bf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.379104 Jul 15 14:02:55.225904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 110/218] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:54 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:56.254888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:56.256749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:56.262159 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=30 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:02:56.270579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:56.271803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:56.273502 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:56.274159 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:56.518802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:56.532801 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-58972376-3be4-48f4-9985-fd41e7fd7551 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.284605 Jul 15 14:02:56.534113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:56 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:02:57.566795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:57.570342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:57.592790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:57.594734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:57.596689 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:57.597858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:58.157327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:58.170852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-df3fdb18-8889-47d1-a21c-057228076cba tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.616327 Jul 15 14:02:58.171725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 111/220] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:57 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:02:59.200322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:02:59.201645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:02:59.210311 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:59.211298 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:59.212094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:02:59.212570 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:02:59.403541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:02:59.411681 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0fa55613-2cbd-455d-acb9-e575fa6a6b5e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.216274 Jul 15 14:02:59.412687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 110/221] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:02:59 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:00.430049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:00.430741 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:00.438141 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:00.438890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:00.439916 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:00.440554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:00.445293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=73 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:00.662627 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:00.687730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0a7867db-cec6-4ee9-9951-31deee44fb55 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.261140 Jul 15 14:03:00.690272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:00 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:01.714247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:01.715857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:01.729200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:01.730107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:01.732096 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:01.733297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:02.023170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:02.040643 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2c0e7533-4082-4225-a8ec-87a233212400 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.335312 Jul 15 14:03:02.041918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:01 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:03.045292 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:03.046174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:03.058597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:03.059389 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:03.060785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:03.061565 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:03.066768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:03.067398 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:03.074331 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:03.074785 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:03.075562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:03.075998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:03.117357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fecb5432-8708-4e52-925b-fe1027469dff tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/ips" status: 200 len: 150 microversion: 2.20 time: 0.080507 Jul 15 14:03:03.118422 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 113/224] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jul 15 14:03:03 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:03:03.283190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:03.304757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d3b6709a-83bb-4c27-9f47-30f4881bb609 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.242251 Jul 15 14:03:03.305965 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 112/225] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:03 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:04.330936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:04.331561 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:04.334159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=24 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:04.342643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:04.343125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:04.343922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:04.344366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:04.501401 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:04.509981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-52d28a49-56a4-485b-95ea-e8ec4e5074ed tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.183102 Jul 15 14:03:04.510561 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:04 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:05.527669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:05.528272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:05.534462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:05.534935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:05.535723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:05.536153 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:05.670630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:05.678658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-52f385a7-4363-42c9-8a73-8a8384b83c80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.155348 Jul 15 14:03:05.679236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 113/227] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:05 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:06.698964 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:06.699497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:06.706001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:06.706443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:06.707226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:06.707648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:06.882992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:06.890829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-91e34216-4962-4e75-b203-089ef49f29cf tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.199166 Jul 15 14:03:06.891401 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 115/228] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:06 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:07.513233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:07.513233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:07.518557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.519008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:07.519807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.520440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:07.547999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lazy-loading 'flavor' on Instance uuid 2f497d21-0e38-4bee-8991-6aae2a4eae9b {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:03:07.622240 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:07.891014 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:07.891854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:07.899084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.899541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:07.900322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.900809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:07.926194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fb810d32-6a61-4538-a8de-f445151b5b47 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/ips" status: 200 len: 145 microversion: 2.1 time: 0.039074 Jul 15 14:03:07.926772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:03:07 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:07.931230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:07.931840 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:07.938347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.938827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:07.939634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:07.940169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:08.119428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:08.127337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d232ea2a-3679-4351-8c54-351837bf4938 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.199538 Jul 15 14:03:08.127928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 117/230] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:07 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:09.145024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:09.145705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:09.154172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:09.154632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:09.155468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:09.155907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:09.322100 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:09.333065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cfb853d9-9b11-4c9f-a870-d2500a23dad1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.191922 Jul 15 14:03:09.334211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 118/231] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:09 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:10.361345 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:10.362031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:10.370092 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:10.370582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:10.371367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:10.371808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:10.532478 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:10.542473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-82f69d9e-e755-4718-8ccf-d2612b051e83 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.185728 Jul 15 14:03:10.543208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 119/232] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:10 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:11.560590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:11.561233 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:11.568746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:11.569230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:11.570105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:11.570549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:11.720860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:11.729875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fbbddfd4-aca5-4250-89c8-09f75c27b5b4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.173306 Jul 15 14:03:11.730522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 120/233] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:11 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:12.250094 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffdaec7d-2247-490b-88fa-daf482704ea2"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:12.252054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:12.258850 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:12.259321 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:12.260620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:12.261054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:12.799934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a5bdccd0-28cf-4a48-a164-e2a606a0e354 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554359 Jul 15 14:03:12.812191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 121/234] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:03:12 2022] POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:03:12.812191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:12.812191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:12.826544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:12.827125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:12.827982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:12.828470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:13.124719 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:13.139172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-17368656-5847-4732-88bf-36a916d8f639 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.335884 Jul 15 14:03:13.141135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 122/235] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:12 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:14.175886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:14.176674 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:14.184161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:14.184653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:14.185435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:14.186062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:14.346842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:14.355518 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-de5c61b1-1fe4-43a0-8c1c-fcc61d321e5d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.185345 Jul 15 14:03:14.356230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 123/236] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:14 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:15.375044 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:15.375945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:15.383479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:15.384219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:15.386011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:15.386464 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:15.554618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:15.565566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d577c08a-bdad-4703-99bc-b7fe7d1fd74e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.195000 Jul 15 14:03:15.566150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 124/237] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:15 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:16.582889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:16.583570 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:16.591240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:16.591778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:16.593151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:16.593151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:16.852672 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:16.868198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-42b011c7-6703-4e63-bc3a-a78400bcc584 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.289195 Jul 15 14:03:16.869639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 125/238] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:16 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:17.517333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=11 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:17.639743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:17.893913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:17.895109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:17.913750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:17.914499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:17.916731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:17.917740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:18.132170 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:18.140736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-91c5e255-a6c1-4968-adc9-abf5eb0ca469 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.257753 Jul 15 14:03:18.141307 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 126/239] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:17 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:19.159109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:19.160008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:19.172337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:19.172846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:19.173663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:19.174121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:19.352623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:19.361804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-53f31165-e570-41e1-89e3-5f49c0cb243e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.207691 Jul 15 14:03:19.362416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 127/240] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:19 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:20.384215 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:20.385828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:20.394939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:20.395635 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:20.396723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:20.397297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:20.402643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:20.567688 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:20.577777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9809288b-92ce-4b5e-b591-5a3c1f24bfa2 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.197494 Jul 15 14:03:20.578383 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 128/241] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:20 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:20.586426 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f247d799-3208-4cbc-bd8e-f381ee7745d7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:20.594079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f247d799-3208-4cbc-bd8e-f381ee7745d7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:20.594716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f247d799-3208-4cbc-bd8e-f381ee7745d7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:20.663772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f247d799-3208-4cbc-bd8e-f381ee7745d7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Going to try to stop instance {{(pid=117861) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 14:03:20.713062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f247d799-3208-4cbc-bd8e-f381ee7745d7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action" status: 202 len: 0 microversion: 2.1 time: 0.133246 Jul 15 14:03:20.713694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 129/242] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:03:20 2022] POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:03:20.727540 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:20.728266 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:20.737258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:20.738272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:20.740864 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:20.741437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:20.916382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:20.924705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-11da3412-71b3-4e62-90be-fc2d7bfd7df6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.203645 Jul 15 14:03:20.925281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 130/243] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:20 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:21.278476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6baf5b79-abeb-4ce8-a0ff-f8257b76f9de tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/action" status: 202 len: 0 microversion: 2.20 time: 13.774810 Jul 15 14:03:21.279655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 114/244] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jul 15 14:03:07 2022] POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/action => generated 0 bytes in 13777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:03:21.287736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:21.288367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:21.299212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.299785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:21.300656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.301164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:21.507285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:21.522039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:21.525111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:21.528478 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c563fc1d-9140-4dd5-a293-18e64a3880a4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.244160 Jul 15 14:03:21.529812 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 131/245] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:21 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:21.597313 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:21.598012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:21.605345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.605807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:21.606595 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.607300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:21.818839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:21.833470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d1afdbf3-d2f8-4064-853d-78f728047a1e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.240044 Jul 15 14:03:21.834887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 115/246] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:21 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:21.943309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:21.944548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:21.952053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.952537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:21.953322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:21.953763 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:22.122908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:22.132380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f10c8070-350b-4033-a189-493711ea0e4f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.192743 Jul 15 14:03:22.133036 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 132/247] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:21 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:22.560211 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:22.560843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:22.567425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:22.567885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:22.568705 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:22.569142 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:22.718825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:22.727668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:22.729769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:22.730959 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c7ac9c42-ffad-4278-a8b1-c74afbd0ec3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.175969 Jul 15 14:03:22.731527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 116/248] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:22 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:22.851860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:22.852498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:22.860176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:22.860666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:22.861455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:22.861943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:23.010641 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:23.018990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8b4de004-c23a-428e-ac6a-25375910aa02 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.171014 Jul 15 14:03:23.019590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 133/249] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:22 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:23.150817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:23.151474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:23.158209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:23.158953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:23.159735 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:23.160175 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:23.318871 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:23.327534 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9b22c82c-888b-416d-b927-d1d9d4d31095 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.180507 Jul 15 14:03:23.328334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 117/250] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:23 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:23.750445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:23.751063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:23.760095 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:23.760585 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:23.761373 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:23.761808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:23.984477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:23.998453 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:24.001038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:24.003012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-898244f4-164a-4561-8461-108cde762d38 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.256387 Jul 15 14:03:24.004543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 134/251] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:23 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:03:24.037671 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:24.039160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:24.047515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:24.048132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:24.051895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:24.051895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:24.289170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:24.299942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-58f7b1f9-51c1-4e49-bb8e-08589f8979c6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.266567 Jul 15 14:03:24.300820 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 118/252] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:24 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:24.345554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:24.346210 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:24.353173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:24.353633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:24.354486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:24.354932 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:24.546920 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:24.555348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b5410032-c254-4248-8578-2a433d8c7328 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.213675 Jul 15 14:03:24.556039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 135/253] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:24 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:25.028895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:25.029517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.035957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.036433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.037220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.037654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.206239 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.215308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.216902 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.218073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-983f89ca-795a-4c42-a1a6-c4c073d16f3f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.193865 Jul 15 14:03:25.218627 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 119/254] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:25 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:25.318999 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:25.319663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.327097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.327538 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.328330 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.328801 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.500760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.508697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-be150e4a-09ee-4824-be4a-8a5e86d1ca0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1500 microversion: 2.1 time: 0.194222 Jul 15 14:03:25.509301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 136/255] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:25 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1500 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:25.526987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e748467-b329-4509-8596-ceaa1934eb5f"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:25.528184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.534959 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.535395 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.536173 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.536642 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.565609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] HTTP exception thrown: Cannot 'attach_volume' instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e while it is in vm_state rescued Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Request method failure captured: Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/os-volume_attachments HTTP/1.1 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 74 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMfaDEyIKpd84FJ2rOQ-kI_5629Y6r4gp41GUtGZIm-geOXUyKUsKMXcoU7P57HGIo86Hm7353xEOOFS31dSeXFEF4MaY85UCw0yN8VosxzHvrWIAhA93C_ZofDLqqtyJh0DSi3L1UWXLrO76wmG5imMMJQi2bFxzV9q3fO2Wi7zEQ Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:03:25.569489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77c8c864a31b402880c334c39fbe5a34"}]}] Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: b86c21e37e2a49e9bdd48e15b091ce09 Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {"volumeAttachment": {"volumeId": "2e748467-b329-4509-8596-ceaa1934eb5f"}} Jul 15 14:03:25.570910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Cannot 'attach_volume' instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e while it is in vm_state rescued Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'server_id': '0c6bc8f0-81aa-45df-9fb1-4e581cf0913e', 'body': {'volumeAttachment': {'volumeId': '2e748467-b329-4509-8596-ceaa1934eb5f'}}} Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:03:25.571755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e while it is in vm_state rescued Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:03:25.573554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e while it is in vm_state rescued Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Returning 409 to user: Cannot 'attach_volume' instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e while it is in vm_state rescued {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fb150b4f-aeb3-42d2-970d-32bc8be8901a tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048877 Jul 15 14:03:25.574619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 120/256] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:03:25 2022] POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 14:03:25.582551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:25.583576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.588087 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:25.589060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.594271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.595060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.596355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.597409 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.599377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.600123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.601447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.602138 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.703266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-00e1f917-84cb-4e82-b355-9934be623485 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/action" status: 202 len: 0 microversion: 2.1 time: 0.122637 Jul 15 14:03:25.704416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 121/257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:03:25 2022] POST /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:03:25.717875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:25.718579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:25.725937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.726633 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.727610 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:25.728418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:25.825195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.833737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e5cb126e-0ae3-46b9-8cf8-64a6a1cd7d33 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.259225 Jul 15 14:03:25.834333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 137/258] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:25 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:25.895443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:25.903628 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7e50ae7f-1f62-40c4-80ef-eb56e90a739d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1508 microversion: 2.1 time: 0.194250 Jul 15 14:03:25.904235 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 122/259] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:25 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:26.237456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:26.238477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:26.245899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.246718 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:26.247517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.248213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:26.441003 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:26.451766 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:26.453710 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:26.455516 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-17184173-4f2b-4374-92b4-5520e409266b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.222257 Jul 15 14:03:26.457122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 138/260] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:26 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:26.851557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:26.852177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:26.865749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.866203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:26.867380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.868145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:26.925122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:26.925851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:26.932186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.933040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:26.933887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:26.934639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:27.054635 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:27.062994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f1e1895b-6edb-4ad5-89cd-b4e8794bf69e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.215567 Jul 15 14:03:27.063578 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 123/261] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:26 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:27.100702 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:27.108809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fc5fc3d9-0774-4e8e-a5e6-b21e4b536ff5 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1508 microversion: 2.1 time: 0.189160 Jul 15 14:03:27.109394 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 139/262] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:26 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:27.482622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:27.483214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:27.489470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:27.489918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:27.490717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:27.491155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:27.634721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:27.643436 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:27.644969 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:27.646110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-97550f9d-32dc-4197-8e25-399c5dd20210 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.167719 Jul 15 14:03:27.646674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 124/263] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:27 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:28.082139 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:28.082861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:28.089737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.090193 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.090981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.091428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.126909 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:28.127800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:28.134045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.134494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.135855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.136631 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.326550 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:28.335708 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9a7a460d-d304-4b83-b00d-e389e2a069f9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.257351 Jul 15 14:03:28.336492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 140/264] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:28 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:28.350576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:28.359836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b668d6bd-0c93-429a-b85e-da50d622c5a6 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1508 microversion: 2.1 time: 0.236572 Jul 15 14:03:28.360815 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 125/265] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:28 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:28.665714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:28.667200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:28.677707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.677707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.677707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:28.677707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:28.866919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:28.882069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:28.884879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:28.887555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b66599c9-9aec-46e3-ac93-c1ae5d3865e5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.226982 Jul 15 14:03:28.888548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 141/266] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:28 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:29.356895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:29.358464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:29.365279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.365926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:29.366687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.367303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:29.380569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:29.381790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:29.391643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.392345 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:29.393159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.393605 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:29.594818 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:29.597669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:29.608722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-09b08a23-b8d6-4e9d-80e7-bfc699d0a2d3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1514 microversion: 2.1 time: 0.231736 Jul 15 14:03:29.609725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 142/267] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:29 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:29.613160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2895ff5a-798a-429b-9a11-861186716fcf tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.260689 Jul 15 14:03:29.625554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 126/268] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:29 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:29.915997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:29.917435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:29.925304 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.925759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:29.927169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:29.927772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:30.147944 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:30.152750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:30.167984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:30.169819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:30.171318 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-044b17e3-a658-4b66-88b6-d2096f88bde2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.260009 Jul 15 14:03:30.171965 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 143/269] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:29 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:30.632537 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:30.633155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:30.643201 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:30.643673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:30.644731 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:30.645313 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:30.891602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:30.901891 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ba2557c6-3747-4cbb-a2c1-32638a76a47a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.273150 Jul 15 14:03:30.912787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 127/270] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:30 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:31.064460 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b470c40b-e973-4837-b092-589c6dfc7242 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: .version_select at 0x7fa0c1bed280>, body: {"keypair": {"name": "tempest-keypair-1331717675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByO9dUIba8TacVOC+si3rcK/Ppm3LSgUDWji5r6xiD2U573wS/KsOPCDw9I459wc0hPDDzEoSR5ZLDMqsJpiUcus/61l3hgyY+rxM+CuHArgDJDRioGHXhQXNxNhh2HMA=="}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:31.103526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-b470c40b-e973-4837-b092-589c6dfc7242 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for project 77c8c864a31b402880c334c39fbe5a34. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:03:31.121008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-b470c40b-e973-4837-b092-589c6dfc7242 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for user b86c21e37e2a49e9bdd48e15b091ce09 and project 77c8c864a31b402880c334c39fbe5a34. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:03:31.196545 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:31.197424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:31.211192 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b470c40b-e973-4837-b092-589c6dfc7242 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150903 Jul 15 14:03:31.212493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 144/271] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:03:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:31.226741 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:31.227197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:31.228053 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:31.228574 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:31.920177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:31.920814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:31.929472 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:31.930183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:31.932474 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:31.933157 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:31.995600 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:32.005587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:32.014876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:32.016275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b7d8b123-f535-43b1-bb04-24fe5aa6e0e2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.829057 Jul 15 14:03:32.017370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 128/272] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:31 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:03:32.218780 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:32.231202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-da3433d8-0fde-4e3a-b607-127e321ba7da tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.314919 Jul 15 14:03:32.232083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 145/273] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:31 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:33.034938 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:33.036262 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:33.045500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:33.047596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:33.051272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:33.052014 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:33.141136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1473992161", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb1d6404-603d-43fd-9d2d-2304ecd9066f"}], "security_groups": [{"name": "tempest-securitygroup--509500136"}], "key_name": "tempest-keypair-1331717675", "user_data": "}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:33.374147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] validate_networks() for [('cb1d6404-603d-43fd-9d2d-2304ecd9066f', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:03:33.427539 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:33.439485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:33.441630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:33.443538 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b88cd7f6-b783-4888-b0c2-ddb8e3cbe57e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.412826 Jul 15 14:03:33.445358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 129/274] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:33 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:33.464248 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:33.464891 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:33.472789 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:33.473235 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:33.474252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:33.474672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:33.820808 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:33.825598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:33.833138 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b0d3958b-fc78-4958-9f4b-963a6abd1b1f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.386000 Jul 15 14:03:33.833933 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 130/275] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:33 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:34.156756 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:03:34.157184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:03:34.157657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:03:34.158062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:03:34.158468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:03:34.168879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.169333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:34.170326 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.170771 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:34.189437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:03:34.193983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Getting quotas for user b86c21e37e2a49e9bdd48e15b091ce09 and project 77c8c864a31b402880c334c39fbe5a34. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:03:34.209402 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:03:34.211817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:03:34.278647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-75404547-2f1c-4223-8486-59c341d2ce59 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.141967 Jul 15 14:03:34.279338 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 146/276] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:03:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:03:34.291292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-00fcd77a-f0e5-4d3b-be85-4e03b428eb1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:34.292899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-00fcd77a-f0e5-4d3b-be85-4e03b428eb1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:34.378332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-00fcd77a-f0e5-4d3b-be85-4e03b428eb1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:34.404293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-00fcd77a-f0e5-4d3b-be85-4e03b428eb1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1246 microversion: 2.1 time: 0.117388 Jul 15 14:03:34.405530 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 131/277] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:34 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:34.469215 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:34.470578 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:34.474400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:34.486443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.487412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:34.488503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.489195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:34.765265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:34.774509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:34.776687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:34.778084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-11b48cb6-7891-4229-8127-55a7b129a032 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.313742 Jul 15 14:03:34.778664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 147/278] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:34 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:34.852188 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:34.852933 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:34.860051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.860671 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:34.861761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:34.862453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:35.244565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:35.262363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-20365947-65b1-4b75-a807-876293dabc07 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1723 microversion: 2.1 time: 0.414725 Jul 15 14:03:35.263177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 132/279] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:34 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:35.423511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:35.424651 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:35.432072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:35.432909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:35.433971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:35.434870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:35.515080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:35.537695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-46419dd8-4ef7-4a39-876d-a93b1470b599 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1250 microversion: 2.1 time: 0.119037 Jul 15 14:03:35.538896 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 148/280] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:35 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1250 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:35.798442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:35.799112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:35.807890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:35.808363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:35.809158 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:35.809765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.000646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:36.027660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:36.029977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:36.032148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f1bc4b65-b953-4c82-9541-779beb2218c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.238668 Jul 15 14:03:36.033272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 133/281] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:35 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:36.281065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:36.281926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:36.293134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.293134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.293871 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.294380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.497340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:36.506958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c151aef6-cf7d-49c3-a80e-0598fb28e89b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1700 microversion: 2.1 time: 0.230266 Jul 15 14:03:36.507546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 149/282] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:36 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1700 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:36.527848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1e69dc6a-e2b0-4b18-9c26-22e3664e8630 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:36.536454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1e69dc6a-e2b0-4b18-9c26-22e3664e8630 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.537030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1e69dc6a-e2b0-4b18-9c26-22e3664e8630 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.555618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:36.559776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:36.567676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.569275 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.571300 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.572111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.613457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1e69dc6a-e2b0-4b18-9c26-22e3664e8630 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Going to try to start instance {{(pid=117862) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 14:03:36.678249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:36.686929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f9e19780-2a6c-446a-af66-72374c241120 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1306 microversion: 2.1 time: 0.135057 Jul 15 14:03:36.689268 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 150/283] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:36 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1306 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:36.831008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1e69dc6a-e2b0-4b18-9c26-22e3664e8630 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action" status: 202 len: 0 microversion: 2.1 time: 0.309135 Jul 15 14:03:36.833297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 134/284] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:03:36 2022] POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:03:36.843454 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:36.844235 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:36.855280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.856905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:36.858041 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:36.858505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:37.029439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:37.048062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-04b32faa-a145-49c7-82cb-6e9cdbbc54b3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1709 microversion: 2.1 time: 0.209978 Jul 15 14:03:37.049126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 151/285] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:36 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:37.058549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:37.059678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:37.067337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:37.068061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:37.069070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:37.069854 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:37.230619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:37.239900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:37.241444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:37.242621 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-aea3e7e5-f24b-4d33-b6af-588bdcabbd1f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.189190 Jul 15 14:03:37.253915 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 135/286] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:37 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:37.707191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:37.708065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:37.720873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:37.723308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:37.724231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:37.724719 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:37.934519 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:37.946544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-040caf62-f25a-4d36-ae18-e841ec191f65 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1304 microversion: 2.1 time: 0.246425 Jul 15 14:03:37.947537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 152/287] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:37 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:38.067713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:38.068537 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:38.077783 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.078554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:38.079652 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.080526 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:38.264273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:38.265476 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:38.283136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.283601 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:38.284668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.285111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:38.427244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:38.439279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b210210a-02c3-46eb-9e09-8ad6e57f586a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1709 microversion: 2.1 time: 0.376030 Jul 15 14:03:38.445459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 136/288] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:38 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1709 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:38.559079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:38.569989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:38.571799 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:38.573920 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ed942a11-3fb1-4aaf-adc4-de1698acbe8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.316045 Jul 15 14:03:38.575243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 153/289] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:38 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:38.963400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:38.964014 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:38.987229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.988760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:38.991496 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:38.992241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:39.465196 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:39.466685 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:39.488825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:39.489785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:39.491026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:39.491794 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:39.565206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:39.582553 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-856b5e3b-571f-4bd8-96e6-14a4e3490392 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.622959 Jul 15 14:03:39.596353 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 137/290] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:38 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:39.602391 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:39.603254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:39.616877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:39.617773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:39.618828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:39.619570 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:40.027715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:40.043732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:40.058578 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:40.063269 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a1873f5d-6348-4f1c-8856-c396e8c7a3ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.465359 Jul 15 14:03:40.063844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 138/291] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:39 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:40.100405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:40.111876 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-456555e0-52bc-49f1-934a-8b3ea105672a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1713 microversion: 2.1 time: 0.651717 Jul 15 14:03:40.116531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 154/292] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:39 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1713 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:40.171810 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-f1c0976c-40bb-43c5-af74-ee0ee3da9a2d req-7d1633cd-93c1-42fc-b611-2ffc20ec7e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:40.190334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-f1c0976c-40bb-43c5-af74-ee0ee3da9a2d req-7d1633cd-93c1-42fc-b611-2ffc20ec7e44 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:40.196533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-f1c0976c-40bb-43c5-af74-ee0ee3da9a2d req-7d1633cd-93c1-42fc-b611-2ffc20ec7e44 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:40.243857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-f1c0976c-40bb-43c5-af74-ee0ee3da9a2d req-7d1633cd-93c1-42fc-b611-2ffc20ec7e44 service nova] Creating event network-changed:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:03:40.262408 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-f1c0976c-40bb-43c5-af74-ee0ee3da9a2d req-7d1633cd-93c1-42fc-b611-2ffc20ec7e44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097521 Jul 15 14:03:40.265385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 139/293] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:40.602534 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:40.603272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:40.612945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:40.613541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:40.614638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:40.615200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:40.868806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:40.880073 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3ef63f51-62c3-41bc-882b-76591ce3f15f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.281733 Jul 15 14:03:40.881396 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 155/294] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:40 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:41.083596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:41.085346 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:41.096942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:41.097827 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:41.098762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:41.099519 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:41.385899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:41.397451 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:41.399124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:41.400456 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8650c823-cb61-479d-b4b4-38a4c8c36a97 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.321576 Jul 15 14:03:41.401934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 140/295] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:41 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:41.898545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:41.900192 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:41.912374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:41.913209 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:41.914191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:41.914800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:42.230276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:42.238602 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-de57eec9-d5a0-4d8a-8693-14e99835a71b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.343944 Jul 15 14:03:42.239331 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 156/296] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:41 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:03:42.421335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:42.422108 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:42.428978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:42.429427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:42.430198 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:42.430888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:42.696562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:42.714918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:42.717919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:42.720195 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bc7995e1-03e8-49fa-80ba-4517d6f90181 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.302807 Jul 15 14:03:42.734714 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 141/297] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:42 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:43.256873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:43.257638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:43.274666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:43.275853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:43.277952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:43.279633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:43.507975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:43.518499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d5b8ffa1-c419-4e49-bc0a-e5b2e16dff25 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.266028 Jul 15 14:03:43.528590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 157/298] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:43 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:43.740999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:43.741656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:43.765104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:43.765104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:43.765104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:43.765104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:44.129486 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:44.142234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:44.144254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:44.147737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-986e6588-4443-48a8-818c-56f01ab27371 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.410672 Jul 15 14:03:44.148370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 142/299] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:43 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:44.537437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:44.538698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:44.541048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:44.541736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=10 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:44.548179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:44.548742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:44.549800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:44.550436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:44.771525 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:44.782446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-19d40993-5b74-4c45-aa8f-8e12d4b7869f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.248785 Jul 15 14:03:44.783001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 158/300] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:44 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:45.163762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:45.170655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:45.171374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:45.178304 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:45.179075 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:45.180213 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:45.180862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:45.266697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-6ea45689-b291-47be-a90b-492f69ed1a72 req-31a6a4cd-6a99-4309-b9b7-c554b301c1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "name": "network-vif-plugged", "status": "completed", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:45.291816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-6ea45689-b291-47be-a90b-492f69ed1a72 req-31a6a4cd-6a99-4309-b9b7-c554b301c1c4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:45.292609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-6ea45689-b291-47be-a90b-492f69ed1a72 req-31a6a4cd-6a99-4309-b9b7-c554b301c1c4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:45.345009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-6ea45689-b291-47be-a90b-492f69ed1a72 req-31a6a4cd-6a99-4309-b9b7-c554b301c1c4 service nova] Creating event network-vif-plugged:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:03:45.356088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-6ea45689-b291-47be-a90b-492f69ed1a72 req-31a6a4cd-6a99-4309-b9b7-c554b301c1c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093134 Jul 15 14:03:45.356594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 159/301] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:03:45.455535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:45.465983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:45.468462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:45.469977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-780a99f9-0977-4ff6-a8e1-dca4648ab180 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.307085 Jul 15 14:03:45.471209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 143/302] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:45 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:45.808838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:45.816140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:45.843032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:45.844049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:45.845705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:45.846314 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:46.489032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:46.489618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:46.503784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:46.504435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:46.505039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:46.505469 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:46.566372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:46.576147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-82bc66cd-95ad-4005-92a1-17cd6ede52c8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1371 microversion: 2.1 time: 0.780140 Jul 15 14:03:46.578009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 160/303] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:45 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1371 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:46.730079 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:46.745562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:46.748123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:46.749596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4757e37d-cbaf-4deb-9f3e-c117b71ada60 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.264638 Jul 15 14:03:46.765707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 144/304] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:46 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:47.592306 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:47.593581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:47.607144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:47.607863 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:47.608665 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:47.609264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:47.770202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:47.771694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:47.778373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=63 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:47.791768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:47.792645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:47.795254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:47.795919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:48.031639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:48.045627 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f5fd33e7-9ab1-4812-bed5-65c6cdc6af12 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1565 microversion: 2.1 time: 0.456633 Jul 15 14:03:48.060552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 161/305] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:03:47 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1565 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:03:48.074587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:48.075492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:48.090105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:48.093235 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:48.094197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:48.094798 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:48.279319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3ccf4e95-51dc-4240-8425-0ba2ee3afe1f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217023 Jul 15 14:03:48.281221 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 162/306] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:03:48 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:48.497763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:48.507428 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:48.509616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:48.511214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a40bfe57-3e4e-4e43-b7c2-07e71b66ba9f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.745588 Jul 15 14:03:48.512054 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 145/307] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:47 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:49.531886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:49.533172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:49.547049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:49.553302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:49.554112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:49.554556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:49.559709 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:49.892320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:49.904900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:49.906443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:49.907636 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e377a7e8-a87e-459b-a7cf-073231db9388 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1743 microversion: 2.20 time: 0.380291 Jul 15 14:03:49.927923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 163/308] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:49 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1743 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:50.393551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-15a63d27-2c01-4a53-b31e-b3af2dd9d84a req-8bebe997-5a31-4f71-a256-658f9b7c66dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:50.414677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-15a63d27-2c01-4a53-b31e-b3af2dd9d84a req-8bebe997-5a31-4f71-a256-658f9b7c66dc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:50.415208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-15a63d27-2c01-4a53-b31e-b3af2dd9d84a req-8bebe997-5a31-4f71-a256-658f9b7c66dc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:50.437441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-15a63d27-2c01-4a53-b31e-b3af2dd9d84a req-8bebe997-5a31-4f71-a256-658f9b7c66dc service nova] Creating event network-changed:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:03:50.448468 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-15a63d27-2c01-4a53-b31e-b3af2dd9d84a req-8bebe997-5a31-4f71-a256-658f9b7c66dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058286 Jul 15 14:03:50.451451 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 146/309] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:50.932273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:50.933207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:50.969484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:50.970683 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:50.972216 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:50.974082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:51.214043 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:51.233919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:51.244467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:51.245715 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3bf2b855-1a8c-4498-9a8e-d8cedc4e7414 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.320323 Jul 15 14:03:51.260542 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 164/310] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:50 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:52.022869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-1e4ce4a6-6df0-4dc3-bb71-e12505916fe1 req-42f58ec9-5a4d-4e51-9e52-93307b6b9c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "name": "network-vif-plugged", "status": "completed", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:52.045709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-1e4ce4a6-6df0-4dc3-bb71-e12505916fe1 req-42f58ec9-5a4d-4e51-9e52-93307b6b9c0c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:52.047542 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-1e4ce4a6-6df0-4dc3-bb71-e12505916fe1 req-42f58ec9-5a4d-4e51-9e52-93307b6b9c0c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:52.078933 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-1e4ce4a6-6df0-4dc3-bb71-e12505916fe1 req-42f58ec9-5a4d-4e51-9e52-93307b6b9c0c service nova] Creating event network-vif-plugged:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:03:52.092999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-1e4ce4a6-6df0-4dc3-bb71-e12505916fe1 req-42f58ec9-5a4d-4e51-9e52-93307b6b9c0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077495 Jul 15 14:03:52.094899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 147/311] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:03:52.265206 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:52.265750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:52.284775 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:52.287913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:52.295234 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:52.295642 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:52.794931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:52.804298 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:52.805990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:52.809352 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6a9b3f86-6222-4685-82ba-d36fdc4a0d5a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.548659 Jul 15 14:03:52.810273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 165/312] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:52 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:53.831908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:53.832953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:53.843951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:53.846950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:53.847943 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:53.848535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:54.148563 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:54.162015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:54.170660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:54.175309 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e71d4e53-c3d6-4807-b5f7-028113f30e7a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.348033 Jul 15 14:03:54.176540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 148/313] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:53 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:55.196195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:55.196842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:55.219199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:55.220370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:55.221708 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:55.222775 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:55.443428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:55.470314 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:55.475781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:55.478265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a1ab8cc0-f838-4612-bb9e-6de6044c54e8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.287077 Jul 15 14:03:55.481382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 166/314] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:55 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:56.509162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:56.509813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:56.520203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:56.520667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:56.521447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:56.521889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:56.564489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:03:56.787757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:56.803112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:56.804745 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:56.828951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7693efd7-9ced-496c-bb68-74455526f10f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.323304 Jul 15 14:03:56.845211 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 149/315] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:56 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:03:57.852007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:57.852661 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:57.872985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:57.873530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:57.874579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:57.874788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:58.104292 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:58.117971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:58.120790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:58.126296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3ad02339-97d5-4ef8-af4c-21ee5d1de4f2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.278053 Jul 15 14:03:58.136918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 167/316] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:57 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:58.841842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-346bab5d-f685-411e-8bdb-20914449f763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'create', calling method: .version_select at 0x7fa0c13b11f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-53331937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDtgIkDqqUxQ6PxuI2/5QQ9Fg7f8YY38BMJlDbWZMCtEQan9ya3eYPzB2Sk5T38TLe2BIBuCIcYaPibXWO3gn5nz0Kpot+DxtzJIUWIzJlZKOcvVee4+THQa0BN9JXPSg=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:58.865705 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-346bab5d-f685-411e-8bdb-20914449f763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Getting quotas for project 11bf10102c9244f99f64ad5b4177407a. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:03:58.873633 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-346bab5d-f685-411e-8bdb-20914449f763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Getting quotas for user a84ea9c601c44d75a19dee660c4ca756 and project 11bf10102c9244f99f64ad5b4177407a. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:03:58.920315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-346bab5d-f685-411e-8bdb-20914449f763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.084019 Jul 15 14:03:58.922541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 150/317] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:03:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:03:59.039615 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-317728558", "imageRef": "a257be17-bb85-4162-b3e0-c1ea553ffa51", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-53331937", "networks": [{"uuid": "f8c850dd-dcf5-4148-9169-912c6adf10f1"}]}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:03:59.100816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] validate_networks() for [('f8c850dd-dcf5-4148-9169-912c6adf10f1', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:03:59.152476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:03:59.153094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:03:59.192732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:59.193398 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:59.194392 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:59.194941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:59.568622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:59.581488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:59.584367 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:03:59.586737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e3f5dd8c-4ddb-4c2d-867b-cc9e45fd83d5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.438416 Jul 15 14:03:59.588957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 151/318] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:03:59 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:03:59.907158 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:03:59.908821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:03:59.909526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:03:59.910454 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:03:59.911065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:03:59.933148 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:59.934179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:59.935380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:03:59.935821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:03:59.966050 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Getting quotas for project 11bf10102c9244f99f64ad5b4177407a. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:03:59.974521 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Getting quotas for user a84ea9c601c44d75a19dee660c4ca756 and project 11bf10102c9244f99f64ad5b4177407a. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:03:59.993355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:03:59.996079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a257be17-bb85-4162-b3e0-c1ea553ffa51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:04:00.074313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ef2140d7-932a-437f-b47e-c64eed6b7a16 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037984 Jul 15 14:04:00.084339 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 168/319] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 14:04:00.089841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-542e4cdd-fe11-4740-894c-2efe9bd4b5f3 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:00.091065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-542e4cdd-fe11-4740-894c-2efe9bd4b5f3 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:00.175285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-542e4cdd-fe11-4740-894c-2efe9bd4b5f3 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:00.182736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-542e4cdd-fe11-4740-894c-2efe9bd4b5f3 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1256 microversion: 2.1 time: 0.097377 Jul 15 14:04:00.183320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 152/320] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:00 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1256 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:00.607995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:00.609893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:00.618191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:00.619564 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:00.620614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:00.623510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:00.832759 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:00.844753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:00.848298 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:00.850797 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-24da8167-dc22-427f-8f3a-f809c92a7380 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.246534 Jul 15 14:04:00.852557 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 169/321] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:00 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:01.201505 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:01.202199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:01.210115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:01.210986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:01.211989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:01.213488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:01.331227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:01.342169 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-34b86eac-15b1-441a-a8cb-9add8ead3fc7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1308 microversion: 2.1 time: 0.145595 Jul 15 14:04:01.352888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 153/322] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:01 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:01.883410 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:01.901711 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:01.914688 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:01.915475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:01.916317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:01.916919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:02.229477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:02.239149 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:02.245849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:02.247775 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-295c58ea-d6f9-4d95-a399-c637ef4fa308 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.370253 Jul 15 14:04:02.248663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 170/323] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:01 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:02.366769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:02.376999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:02.407562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:02.408222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:02.409255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:02.409940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:02.779886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:02.796090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0d7e05e7-ea2f-49ee-8704-3f9b2010e470 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.439331 Jul 15 14:04:02.797115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 154/324] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:02 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:03.266767 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:03.270956 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:03.282913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:03.289600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:03.291136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:03.291925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:03.653755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:03.674812 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:03.682643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:03.683907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5e04b025-e208-437d-afd4-e981f26ae94c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.421091 Jul 15 14:04:03.684600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 171/325] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:03 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:03.739780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-4c3226a5-2c7f-43d4-a281-0ca09829aa84 req-bf00c5b3-6cdf-4fd6-9a20-057561f21266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:03.776862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-4c3226a5-2c7f-43d4-a281-0ca09829aa84 req-bf00c5b3-6cdf-4fd6-9a20-057561f21266 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:03.786912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-4c3226a5-2c7f-43d4-a281-0ca09829aa84 req-bf00c5b3-6cdf-4fd6-9a20-057561f21266 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:03.818742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:03.822193 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:03.844066 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-4c3226a5-2c7f-43d4-a281-0ca09829aa84 req-bf00c5b3-6cdf-4fd6-9a20-057561f21266 service nova] Creating event network-changed:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:04:03.854286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:03.861723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:03.863505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:03.864670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:03.871187 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-4c3226a5-2c7f-43d4-a281-0ca09829aa84 req-bf00c5b3-6cdf-4fd6-9a20-057561f21266 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135783 Jul 15 14:04:03.877119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 155/326] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:04:04.227819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:04.239566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-340cc512-5316-4b97-a8d8-9db20107cc3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.429001 Jul 15 14:04:04.253495 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 172/327] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:03 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:04.713670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:04.715442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:04.724501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:04.725834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:04.727015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:04.728527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:04.923524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:04.933168 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:04.934704 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:04.935889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d393beb7-5c06-4ec7-8ab6-72ec7f6bd842 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.231406 Jul 15 14:04:04.938037 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 156/328] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:04 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:05.260683 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:05.261390 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:05.263685 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:05.268670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:05.269119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:05.269939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:05.270608 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:05.461795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:05.472988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-705ac236-fcf2-4e53-8a33-f2542f82df17 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.215971 Jul 15 14:04:05.473819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 173/329] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:05 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:05.954219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:05.954832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:05.961203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:05.961648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:05.962439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:05.963469 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:06.095471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:06.105233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:06.106778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:06.108242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f2ef2dfc-337b-4b48-8bde-aa9ba6af348f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.157855 Jul 15 14:04:06.108839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 157/330] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:05 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:06.497155 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:06.497966 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:06.505089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:06.505541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:06.506354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:06.506808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:06.697042 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:06.705842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2f907408-877d-45ec-934d-10872649a10c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.214206 Jul 15 14:04:06.706441 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 174/331] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:06 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:07.126659 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:07.127523 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:07.134086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:07.134585 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:07.135360 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:07.135787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:07.288070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:07.297577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:07.299100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:07.300503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4f1d27ee-acb9-4eda-8ea9-9851765c09b1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.177927 Jul 15 14:04:07.301051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 158/332] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:07 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:07.723128 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:07.723740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:07.731176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:07.731624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:07.732995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:07.733503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:07.885884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:07.894064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a74647a3-25f7-400c-8bc5-f29a3b0b15fe tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.174803 Jul 15 14:04:07.905271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 175/333] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:07 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:08.320364 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:08.321110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:08.328513 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:08.328993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:08.329777 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:08.330212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:08.471828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:08.479983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:08.481596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:08.483012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7a9addba-39b2-467a-9d2b-2ea06020b946 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.166551 Jul 15 14:04:08.483571 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 159/334] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:08 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:08.915054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:08.916620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:08.923576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:08.924099 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:08.925040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:08.925522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:09.094355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:09.101945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-18c22b4b-6c76-4e84-bc38-ecea046186d5 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.190754 Jul 15 14:04:09.102523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 176/335] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:08 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:09.500357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:09.501172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:09.507399 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:09.507842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:09.508648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:09.509082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:09.643704 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:09.653996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:09.660041 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:09.669771 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d9e25f18-738b-4708-8ac6-cbf9b6521e28 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.169559 Jul 15 14:04:09.670646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 160/336] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:09 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:10.120668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:10.121473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:10.123802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:10.125074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:10.131132 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:10.131536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:10.132657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:10.133106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:10.311007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:10.318748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-52c72a63-0e32-42c0-afb9-e5e324eee829 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.202841 Jul 15 14:04:10.319336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 177/337] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:10 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:10.691356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:10.691966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:10.693823 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=6 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:10.699954 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:10.700422 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:10.701191 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:10.701618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:10.861997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:10.876499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:10.879616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:10.883439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7a31d42c-911e-4fe2-a3bc-3df618bb90f9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.195441 Jul 15 14:04:10.901165 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 161/338] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:10 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:11.336237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:11.336887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:11.343573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:11.344022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:11.344869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:11.345307 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:11.491216 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:11.499851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3b14693d-3def-4e15-95a9-527ab69547cf tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.167550 Jul 15 14:04:11.500537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 178/339] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:11 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:11.915626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:11.916689 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:11.923360 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:11.923830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:11.925215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:11.926079 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:12.075958 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:12.084320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:12.085713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:12.086899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-211336e4-3c75-4937-b134-a62b86c5f4a7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.175518 Jul 15 14:04:12.087791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 162/340] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:11 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:12.517295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:12.517865 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:12.524402 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:12.524873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:12.525671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:12.526111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:12.669949 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:12.678482 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-255d4c7a-d96f-4f41-bcf4-efc6b4922877 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.165090 Jul 15 14:04:12.679285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 179/341] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:12 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:13.107281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:13.108211 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:13.114256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:13.114699 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:13.115474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:13.115898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:13.245099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:13.253091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:13.254624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:13.256314 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b86c2a36-f838-4e26-b452-a5fb99c44a10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1738 microversion: 2.20 time: 0.153280 Jul 15 14:04:13.256919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 163/342] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:13 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:13.701658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:13.703242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:13.715552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:13.717983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:13.717983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:13.718212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:13.746516 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:13.880705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:13.890683 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8fb71ab9-6261-416d-8bb3-95df72229acb tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.196968 Jul 15 14:04:13.891553 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 180/343] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:13 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:14.274470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:14.275063 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:14.281498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:14.281947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:14.282728 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:14.283158 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:14.416998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:14.425315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:14.426833 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:14.427989 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-391a0d5a-b18a-47b9-922c-f559005c5b91 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1720 microversion: 2.20 time: 0.157542 Jul 15 14:04:14.428578 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 164/344] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:14 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:14.908295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:14.908971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:14.916050 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:14.916524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:14.917315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:14.917752 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:15.068181 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:15.077774 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fb3631ff-e00b-45d0-90a0-6b6f378582d2 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.173239 Jul 15 14:04:15.078786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 181/345] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:14 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:15.448671 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:15.449303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:15.455726 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:15.456172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:15.456974 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:15.457410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:15.600654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:15.610124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:15.611614 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:15.612821 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-24b3dda3-e631-45c8-a18c-41c6ca62fc10 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1720 microversion: 2.20 time: 0.168913 Jul 15 14:04:15.613386 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 165/346] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:15 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:16.098846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:16.099600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:16.110668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:16.111913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:16.113299 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:16.114065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:16.264345 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:16.277251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6bf94d20-fc44-4b93-88ff-d89708c56d24 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.185112 Jul 15 14:04:16.277835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 182/347] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:16 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:16.631044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:16.631624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:16.637715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:16.638156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:16.638899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:16.639324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:16.768907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:16.777769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:16.779300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:16.780465 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2f21bb6c-e85a-4797-871c-50113faf4624 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1720 microversion: 2.20 time: 0.153290 Jul 15 14:04:16.781052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 166/348] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:16 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:17.295573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:17.296440 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:17.303297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:17.303854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:17.304743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:17.305243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:17.399930 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-ee540100-bad3-4f97-bfce-d9b0b61c178b req-6266e1f7-46d1-4a30-a7d1-9daadd7b8e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "name": "network-vif-unplugged", "status": "completed", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:17.411018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-ee540100-bad3-4f97-bfce-d9b0b61c178b req-6266e1f7-46d1-4a30-a7d1-9daadd7b8e90 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:17.411884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-ee540100-bad3-4f97-bfce-d9b0b61c178b req-6266e1f7-46d1-4a30-a7d1-9daadd7b8e90 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:17.431064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-ee540100-bad3-4f97-bfce-d9b0b61c178b req-6266e1f7-46d1-4a30-a7d1-9daadd7b8e90 service nova] Creating event network-vif-unplugged:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:04:17.437625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-ee540100-bad3-4f97-bfce-d9b0b61c178b req-6266e1f7-46d1-4a30-a7d1-9daadd7b8e90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041133 Jul 15 14:04:17.438662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 167/349] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:04:17.483169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:17.497060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-07db3652-79ab-446d-b2d8-3529fb193dc1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.205088 Jul 15 14:04:17.498156 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 183/350] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:17 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:17.804034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:17.805338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:17.809092 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:17.817168 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:17.817962 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:17.819323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:17.820092 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:17.979882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:17.990991 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:17.992778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:17.994170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e8f78580-52a5-4e56-96fd-4e5f6dc20a2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1720 microversion: 2.20 time: 0.198385 Jul 15 14:04:17.995938 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 168/351] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:17 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:18.522827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:18.523860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:18.533959 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:18.534429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:18.535234 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:18.535673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:18.679197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:18.687001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fc2607fe-aab8-48b2-8d88-4130c8ec8e76 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.168671 Jul 15 14:04:18.687593 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 184/352] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:18 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:19.015883 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:19.016440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:19.024373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.024841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.025653 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.026086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.044476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=100 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:19.162701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:19.170981 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:19.172505 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:19.173678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c2419f07-4741-4d82-8a99-fd1284391598 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1663 microversion: 2.20 time: 0.161813 Jul 15 14:04:19.174226 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 169/353] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:19 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:19.192998 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "950d16f3-afbc-4198-833a-026eaa3afac8"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:19.194115 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:19.200804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.201266 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.202052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.202626 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.475055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-5345aa0b-ed37-4e02-b02d-7df067f6e33d req-98d42d75-d96e-474e-9d7a-cae60234a84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "name": "network-vif-plugged", "status": "completed", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:19.486439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5345aa0b-ed37-4e02-b02d-7df067f6e33d req-98d42d75-d96e-474e-9d7a-cae60234a84c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.487359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5345aa0b-ed37-4e02-b02d-7df067f6e33d req-98d42d75-d96e-474e-9d7a-cae60234a84c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.502752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-5345aa0b-ed37-4e02-b02d-7df067f6e33d req-98d42d75-d96e-474e-9d7a-cae60234a84c service nova] Creating event network-vif-plugged:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:04:19.508687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-5345aa0b-ed37-4e02-b02d-7df067f6e33d req-98d42d75-d96e-474e-9d7a-cae60234a84c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037559 Jul 15 14:04:19.509877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 170/354] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:04:19.537061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e62581bf-1799-4de8-9ca5-1104ee7a891d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347795 Jul 15 14:04:19.538024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 185/355] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jul 15 14:04:19 2022] POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:04:19.662522 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:19.663162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:19.669944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.670379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.671134 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.671556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.703107 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:19.703984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:19.712825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.713276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.714082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:19.714520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:19.771200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [45e2d061-9e42-4973-b605-6245b3dd48e2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 14:04:19.846295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:19.854510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-07279624-76bf-4202-846d-dda4e97e1a47 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.154691 Jul 15 14:04:19.855100 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 186/356] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:19 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:20.779205 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [45e2d061-9e42-4973-b605-6245b3dd48e2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58716. Jul 15 14:04:20.782816 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a5d160cb-1289-40ad-97a9-b4bec74dfb9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/action" status: 202 len: 0 microversion: 2.20 time: 1.124600 Jul 15 14:04:20.783453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 171/357] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jul 15 14:04:19 2022] POST /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:04:20.792169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:20.792815 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:20.799328 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:20.799778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:20.800583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:20.801023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:20.891049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:20.891463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:20.898723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:20.899486 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:20.900579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:20.901706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:20.960557 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:20.970379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:20.971885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:20.973239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-86b9b59d-e87e-43fa-93da-0c4accfae093 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1749 microversion: 2.20 time: 0.185569 Jul 15 14:04:20.974213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 187/358] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:20 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:21.052148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:21.060249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c600a8d0-d3ed-4455-898d-26b017acbaee tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1356 microversion: 2.1 time: 0.173195 Jul 15 14:04:21.060854 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 172/359] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:20 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:21.992214 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:21.992873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:21.999378 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:21.999828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.000623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.001062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.077053 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:22.077841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:22.084107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.084591 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.085668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.085768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.164684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.173874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.175382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.176583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2b797a59-1291-4557-8dd4-1b84bc308a18 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1751 microversion: 2.20 time: 0.188344 Jul 15 14:04:22.179074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 188/360] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:21 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:22.227904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.236581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8b77ff06-2409-47fd-a1ee-1772cfb060fc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1544 microversion: 2.1 time: 0.163403 Jul 15 14:04:22.237147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 173/361] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:22 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1544 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:22.253140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:22.253752 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:22.260442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.260901 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.261734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.262194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.402274 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.410728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-49d11c5d-fd00-4c69-b1b0-3c9cfd0b9b1b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1544 microversion: 2.1 time: 0.161287 Jul 15 14:04:22.411402 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 189/362] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:22 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1544 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:22.428862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:22.432459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.433247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Searching by: {'deleted': False, 'project_id': '11bf10102c9244f99f64ad5b4177407a'} {{(pid=117862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 15 14:04:22.440052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.440487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.441272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.441703 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.543611 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.multi_cell_list [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 15 14:04:22.646316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4bfc49e1-cd70-412b-b933-117f14b48549 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.222265 Jul 15 14:04:22.646822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 174/363] 10.222.0.16 () {58 vars in 1124 bytes} [Fri Jul 15 14:04:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:04:22.657427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:22.658038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:22.664002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.664499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.665265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:22.665709 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:22.802024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:22.810301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2cb88bd6-cb27-4685-ba51-81d76038edaa tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1544 microversion: 2.1 time: 0.156628 Jul 15 14:04:22.810879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 190/364] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:22 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1544 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:23.197514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:23.198083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:23.204135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:23.204616 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:23.205407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:23.205845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:23.337599 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:23.346091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:23.347609 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:23.348774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2d427ea8-ad16-428b-9017-ef4d619ac469 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.155162 Jul 15 14:04:23.349321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 175/365] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:23 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:23.618975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:23.619488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:23.625881 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:23.626323 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:23.627077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:23.627504 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:23.757870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lazy-loading 'services' on Instance uuid 4a543a41-bbbc-4c3a-833a-903faa97dde7 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:04:23.881446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3353172a-59d0-4622-8bdb-b01e20b84963 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments/ffdaec7d-2247-490b-88fa-daf482704ea2" status: 202 len: 0 microversion: 2.1 time: 0.266018 Jul 15 14:04:23.882746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 191/366] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:04:23 2022] DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments/ffdaec7d-2247-490b-88fa-daf482704ea2 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:04:24.369420 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:24.370681 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:24.381080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:24.381832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:24.385000 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:24.385737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:24.463077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cf7590-0e2a-4a50-9094-102ea958f568"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:24.464722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:24.471980 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:24.472837 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:24.473658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:24.474103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:24.585279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:24.594877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:24.596412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:24.597613 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-378e7b11-0319-482b-a4d2-c39f732dc179 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.232917 Jul 15 14:04:24.598182 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 176/367] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:24 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:25.626032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:25.628153 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:25.640013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:25.640840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:25.642222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:25.643022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:25.791230 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:25.800793 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:25.802626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:25.803939 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-806ce6fd-f417-4a9f-bcda-7215c2e5c750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.185000 Jul 15 14:04:25.804660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 177/368] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:25 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:26.823251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:26.824236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:26.832894 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:26.833368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:26.834141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:26.836354 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:26.985973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:26.994932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:26.996549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:26.997721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-082d8392-9336-4b69-95de-cd99d1c98750 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.178385 Jul 15 14:04:27.008526 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 178/369] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:26 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:28.015521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:28.016281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:28.022786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:28.023305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:28.024305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:28.024772 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:28.190885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:28.200500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:28.202271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:28.203640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cf9a5261-27e8-4641-9901-925ec402654c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.192118 Jul 15 14:04:28.204810 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 179/370] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:28 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:29.222641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:29.223376 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:29.230475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:29.230919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:29.231887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:29.232521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:29.389476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:29.399389 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:29.400908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:29.402356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-951f5750-421e-44ea-b109-8c6d65ab2561 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.184040 Jul 15 14:04:29.412824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 180/371] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:29 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:30.423551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:30.425017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:30.432087 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:30.433354 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:30.434475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:30.435013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:30.594966 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:30.603856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:30.606910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:30.608983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fce60b1b-51f9-4b34-a0fa-d886c146c82f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.188990 Jul 15 14:04:30.609648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 181/372] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:30 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:31.628525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:31.629136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:31.638888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:31.639524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:31.640115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:31.640584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:31.806057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:31.815938 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:31.817605 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:31.818700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8a42d4b7-25e4-4c33-8306-adbd4e1e5696 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.194899 Jul 15 14:04:31.819264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 182/373] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:31 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:32.837260 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:32.837988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:32.840343 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:32.846257 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:32.846708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:32.847515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:32.847957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:32.992755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:33.002119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:33.003629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:33.004846 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e3e5d553-9edb-4bd9-9d65-3efdb4ba8b2e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.171477 Jul 15 14:04:33.005421 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 183/374] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:32 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:33.418390 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:33.435407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "261b8e09-314b-4672-8fc5-76ebf89940c6"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:33.437205 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:33.447139 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f07fc0fc-48b0-499c-aa18-8981c2e73d3f tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.993421 Jul 15 14:04:33.447388 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:33.447941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:33.448149 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 192/375] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:04:24 2022] POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments => generated 194 bytes in 8996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:04:33.449071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:33.449697 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:33.799575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:33.825710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9febae9c-73f6-4a57-b365-123eaf0ebc0f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397524 Jul 15 14:04:33.826361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 184/376] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:04:33 2022] POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:04:34.023579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:34.024313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:34.031573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:34.032021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:34.032822 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:34.033258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:34.171476 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:34.181603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:34.183745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:34.185034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6ca77bb3-0e84-42d5-9e3b-2b5ff43eddb2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.166239 Jul 15 14:04:34.186644 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 193/377] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:34 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:34.641963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2d47246b-7c3a-4eb8-9769-deaaf7e0edd0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:34.648268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d47246b-7c3a-4eb8-9769-deaaf7e0edd0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:34.648755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2d47246b-7c3a-4eb8-9769-deaaf7e0edd0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:34.671693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2d47246b-7c3a-4eb8-9769-deaaf7e0edd0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Going to try to stop instance {{(pid=117862) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 14:04:34.725682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2d47246b-7c3a-4eb8-9769-deaaf7e0edd0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action" status: 202 len: 0 microversion: 2.1 time: 0.088130 Jul 15 14:04:34.726296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 185/378] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:04:34 2022] POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:04:34.735616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:34.736240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:34.744862 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:34.745315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:34.746106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:34.746546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:34.884891 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:34.895371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-257fefca-26f0-403e-97ae-4d792e37c4f0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.163556 Jul 15 14:04:34.896447 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 194/379] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:34 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:35.204735 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:35.205661 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:35.211987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:35.212470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:35.213249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:35.213692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:35.349910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:35.358880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:35.360463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:35.361624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e21fed55-ea8d-479e-a626-3efc1ac4b431 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.161678 Jul 15 14:04:35.362179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 186/380] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:35 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:35.914246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:35.914807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:35.917734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=44 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:35.923830 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:35.924278 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:35.925079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:35.925514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:36.067933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:36.075606 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2d47c8a0-6ed1-465d-a2d6-15f906139813 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.165189 Jul 15 14:04:36.076186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 195/381] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:35 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:36.379940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:36.380576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:36.390350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:36.391065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:36.392060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:36.392720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:36.536082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:36.545985 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:36.547469 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:36.548665 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-929966e1-4178-42fc-aaa7-247f305b1ab6 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.172665 Jul 15 14:04:36.549214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 187/382] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:36 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:37.095098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:37.095869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:37.102913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:37.103371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:37.104158 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:37.105654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:37.273077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:37.281289 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-db0d3c93-1a8b-4312-af8e-3df57ed249a9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.190338 Jul 15 14:04:37.281855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 196/383] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:37 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:37.567157 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:37.567750 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:37.574777 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:37.575190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:37.575945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:37.576375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:37.714892 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:37.723512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:37.725039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:37.726173 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5f5f0e8b-4fb0-46ac-b0c9-094ee7c8312f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.162925 Jul 15 14:04:37.726718 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 188/384] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:37 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:38.299000 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:38.299673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:38.306341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:38.306787 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:38.308138 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:38.308599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:38.439988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:38.447405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2f2d520b-154c-40b0-b70e-34961aa173e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.152272 Jul 15 14:04:38.447962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 197/385] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:38 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:38.743251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:38.743854 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:38.750640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:38.751088 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:38.751925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:38.752363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:38.883071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:38.891947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:38.893455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:38.894582 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f96936c7-1293-4f5a-9f7e-89430f454d3c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.155128 Jul 15 14:04:38.895130 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 189/386] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:38 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:39.465023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:39.465568 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:39.471971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:39.472649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:39.472649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:39.472649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:39.604363 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:39.612219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d58a58a5-cd7f-43e3-b083-a8296a6b187a tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.151613 Jul 15 14:04:39.612818 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 198/387] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:39 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:39.913788 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:39.914395 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:39.921249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:39.921701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:39.922463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:39.922894 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:40.059956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:40.068597 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:40.070183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:40.071357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-01826846-2b98-4d09-b993-77073bc3d026 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.161499 Jul 15 14:04:40.071917 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 190/388] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:39 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:40.630064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:40.630672 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:40.637205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:40.637489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:40.638246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:40.639105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:40.781257 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:40.788864 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-981c8607-c320-42a9-8ebc-8b52d2f3584b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.162940 Jul 15 14:04:40.789441 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 199/389] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:40 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:40.996098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:40.996746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:41.003263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.003706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.004509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.004951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.091177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:41.091795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:41.098071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.098527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.099305 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.099748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.139741 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:41.150859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fb2ec7a1-0de1-42e4-a35b-3feefb5f1738 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1590 microversion: 2.1 time: 0.158325 Jul 15 14:04:41.151363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 191/390] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:40 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1590 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:41.241690 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:41.254103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:41.255625 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:41.256979 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-daeae487-05c0-4625-933b-a26c9b1f02f3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.170346 Jul 15 14:04:41.261459 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 200/391] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:41 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:41.807200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:41.808935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:41.817271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.817872 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.818719 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:41.819222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:41.978538 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:41.987465 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cba93476-24bf-4a21-87d2-e8b960d77a3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.183903 Jul 15 14:04:41.988082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 192/392] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:41 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:42.277667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:42.278542 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:42.287212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:42.287813 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:42.288720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:42.289459 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:42.442965 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:42.451761 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:42.453311 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:42.454473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0e6de6e5-e428-4342-8807-47353416f627 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.181991 Jul 15 14:04:42.455030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 201/393] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:42 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:04:42.982179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-b1a4c66b-4fbf-46f6-92db-5d1608800886 req-19482bbe-b5b4-4166-99be-018c46529fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:42.991073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b1a4c66b-4fbf-46f6-92db-5d1608800886 req-19482bbe-b5b4-4166-99be-018c46529fee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:42.991517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b1a4c66b-4fbf-46f6-92db-5d1608800886 req-19482bbe-b5b4-4166-99be-018c46529fee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.004132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-b1a4c66b-4fbf-46f6-92db-5d1608800886 req-19482bbe-b5b4-4166-99be-018c46529fee service nova] Creating event network-changed:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:04:43.010062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-b1a4c66b-4fbf-46f6-92db-5d1608800886 req-19482bbe-b5b4-4166-99be-018c46529fee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Jul 15 14:04:43.011454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 193/394] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:04:43.015304 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:43.015917 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:43.024599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:43.025048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.026157 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:43.026848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.444762 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:43.454595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4d4ee40e-d4c9-4055-98d8-a1be3464a0d6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.445027 Jul 15 14:04:43.455966 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 202/395] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:43 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:43.483843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:43.486898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:43.504375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:43.505234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.506645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:43.507282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.728351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:43.754318 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:43.756086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:43.757379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d104e703-7585-4292-89ab-7b857aacfbac tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.285276 Jul 15 14:04:43.757999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 194/396] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:43 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:43.763667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-aadd3ea4-7cbd-4b9a-863b-a59ba95c35c1 req-dbb06d1e-cb56-4377-b488-c3f4f4f65671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "name": "network-vif-plugged", "status": "completed", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:43.776007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-aadd3ea4-7cbd-4b9a-863b-a59ba95c35c1 req-dbb06d1e-cb56-4377-b488-c3f4f4f65671 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:43.777656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-aadd3ea4-7cbd-4b9a-863b-a59ba95c35c1 req-dbb06d1e-cb56-4377-b488-c3f4f4f65671 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:43.793908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-aadd3ea4-7cbd-4b9a-863b-a59ba95c35c1 req-dbb06d1e-cb56-4377-b488-c3f4f4f65671 service nova] Creating event network-vif-plugged:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:04:43.799892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-aadd3ea4-7cbd-4b9a-863b-a59ba95c35c1 req-dbb06d1e-cb56-4377-b488-c3f4f4f65671 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Jul 15 14:04:43.800982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 203/397] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:04:44.483575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:44.484839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:44.494132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.494575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:44.495886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.496302 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:44.545572 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-933203842"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:44.546186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:44.554762 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.555662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:44.556542 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.556906 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:44.684054 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:44.692254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-923e269f-5290-445f-b566-947d24fcb7e7 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1677 microversion: 2.1 time: 0.213346 Jul 15 14:04:44.693409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 195/398] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:44 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:44.737162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.network.security_group_api [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Adding security group 71f6ad5b-4ef7-45b8-b2e7-46313016c14d to port 01da8f8b-bf3b-4832-a1ec-c52703b5ed24 Jul 15 14:04:44.786234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:44.786840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:44.793072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.793523 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:44.794580 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:44.795013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.029047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:45.038316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:45.039805 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:45.041004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b96d58a1-c527-4528-bcd7-8622cf388acf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.258649 Jul 15 14:04:45.041555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 196/399] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:44 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:45.221691 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ddfbed98-3f16-42c4-bb0e-93abd9799425 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action" status: 202 len: 0 microversion: 2.1 time: 0.680307 Jul 15 14:04:45.223192 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 204/400] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:04:44 2022] POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:04:45.238627 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-90197b1e-b0cb-4cbd-941b-058224b2c47f req-1ac55eea-ef7c-498a-b047-d24a9e78dabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:45.245286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:45.246267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:45.253252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-90197b1e-b0cb-4cbd-941b-058224b2c47f req-1ac55eea-ef7c-498a-b047-d24a9e78dabd service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.253701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-90197b1e-b0cb-4cbd-941b-058224b2c47f req-1ac55eea-ef7c-498a-b047-d24a9e78dabd service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.267730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.268603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.269496 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.270036 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.291381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-90197b1e-b0cb-4cbd-941b-058224b2c47f req-1ac55eea-ef7c-498a-b047-d24a9e78dabd service nova] Creating event network-changed:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:04:45.302237 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-90197b1e-b0cb-4cbd-941b-058224b2c47f req-1ac55eea-ef7c-498a-b047-d24a9e78dabd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076341 Jul 15 14:04:45.303134 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 197/401] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:04:45.455546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:45.465958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f1f97ca1-0418-4f74-b9c2-9fd2213987d7 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1754 microversion: 2.1 time: 0.234380 Jul 15 14:04:45.466805 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 205/402] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:45 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1754 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:45.712042 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:45.712820 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:45.719695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.720083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.720908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.721349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.855728 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:45.864925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-668ffec3-901f-434b-ae5e-89628ad2feee tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1654 microversion: 2.1 time: 0.157455 Jul 15 14:04:45.866211 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:45 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:45.889130 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-841695d7-9eb3-4346-91bc-2996b03e42b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:45.895992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-841695d7-9eb3-4346-91bc-2996b03e42b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.896467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-841695d7-9eb3-4346-91bc-2996b03e42b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.920698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-841695d7-9eb3-4346-91bc-2996b03e42b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Going to try to start instance {{(pid=117861) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 14:04:45.965598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-841695d7-9eb3-4346-91bc-2996b03e42b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action" status: 202 len: 0 microversion: 2.1 time: 0.081943 Jul 15 14:04:45.966207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 206/404] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:04:45 2022] POST /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:04:45.974641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:45.975177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:45.981282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.981729 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:45.982494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:45.983196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:46.060779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:46.061521 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:46.068723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:46.069186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:46.070008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:46.070476 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:46.125135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:46.133203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8db00bb1-7f36-403a-aa48-e6d88f358314 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1663 microversion: 2.1 time: 0.162528 Jul 15 14:04:46.134028 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:45 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:46.224639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:46.236080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:46.238226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:46.239391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8c65269a-abea-4d43-bb8f-b8cce2fcd69a tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1807 microversion: 2.20 time: 0.183647 Jul 15 14:04:46.239951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 207/406] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:46 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:47.156292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:47.158125 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:47.169994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.170761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.171672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.172187 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.258289 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:47.259617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:47.268349 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.280928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.285331 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.285989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.420058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:47.429315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-148920dd-69d4-4c97-9881-81779a0e5d88 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1663 microversion: 2.1 time: 0.278765 Jul 15 14:04:47.429895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 200/407] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:47 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1663 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:47.499082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:47.508583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:47.510250 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:47.511473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c6f981ca-0cb3-495e-8798-114899427000 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1794 microversion: 2.20 time: 0.257542 Jul 15 14:04:47.512197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 208/408] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:04:47 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1794 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:04:47.775332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:04:47.776837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:47.782774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.783219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.784072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.784959 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.788887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:47.810402 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lazy-loading 'flavor' on Instance uuid f7f6876c-e419-4a62-b81a-9636359322ff {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:04:47.942792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-076cc554-9f25-49a2-822e-7f23438c4d08 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/action" status: 200 len: 32 microversion: 2.1 time: 0.171262 Jul 15 14:04:47.943954 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 201/409] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:04:47 2022] POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:04:47.954400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:47.955044 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:47.961198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.961645 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.962427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:47.962865 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:47.968071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:48.101857 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:48.110088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a32707e8-496c-432e-9738-33114833d2bb tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.159568 Jul 15 14:04:48.110671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 209/410] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:47 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:48.450529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:48.451229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:48.453241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=70 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:04:48.458907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:48.459357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:48.460134 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:48.460608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:48.610509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:48.618204 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7626233b-f4d2-49dd-9b5c-f7cb73c2c4e5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1663 microversion: 2.1 time: 0.172846 Jul 15 14:04:48.618634 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 202/411] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:48 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:49.127808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:49.128450 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:49.135343 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:49.135799 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:49.136629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:49.137080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:49.288973 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:49.299404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-11c9afa9-1e41-49b2-8b60-bc6bdefec988 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.175379 Jul 15 14:04:49.300131 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 210/412] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:49 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:49.635293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:49.636518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:49.643245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:49.643709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:49.644508 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:49.644950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:49.798979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:49.806832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-41a239bd-5ec6-4b06-8fda-8bdfa18c4219 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1667 microversion: 2.1 time: 0.175332 Jul 15 14:04:49.807350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 203/413] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:49 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:50.316539 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:50.317122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:50.323623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:50.324068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:50.324871 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:50.325307 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:50.465402 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:50.473785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cde7767a-a0f2-40b5-bf0f-8712d8d52663 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.160974 Jul 15 14:04:50.474372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 211/414] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:50 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:51.497034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:51.497639 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:51.504496 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:51.504942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:51.505717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:51.506150 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:51.643322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:51.652194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-11ca3f6f-7607-456c-8768-043eca55d7de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.159512 Jul 15 14:04:51.652786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 204/415] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:51 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:04:52.669962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:52.670566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:52.677401 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:52.677849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:52.678615 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:52.679048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:52.817744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:52.826614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-07ebabcc-a748-499a-9958-3ebaf7df52bd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.160699 Jul 15 14:04:52.827250 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 212/416] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:52 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:53.844532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:53.845125 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:53.851673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:53.852109 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:53.852889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:53.853319 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:53.993114 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:54.001294 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-71f2123d-f81b-4b96-9f73-0cd5750156ad tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.160582 Jul 15 14:04:54.001877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 205/417] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:53 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:55.019659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:55.020281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:55.026709 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:55.027163 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:55.027927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:55.028374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:55.158434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:55.166740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-af1705f2-8727-4375-bfca-ea4301145a74 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.150984 Jul 15 14:04:55.167310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 213/418] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:55 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:56.183099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:56.183708 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:56.191038 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:56.191491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:56.192264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:56.192740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:56.330460 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:56.338704 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4fca44ae-493c-407c-af66-c5b82b3ff121 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.159374 Jul 15 14:04:56.339284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 206/419] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:56 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:57.355077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:57.355744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:57.363220 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:57.363674 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:57.364494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:57.364935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:57.498861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:57.508195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-363edfb9-bc68-496b-8099-124f474c7ea8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.156891 Jul 15 14:04:57.508820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 214/420] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:57 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:58.526509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:58.527044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:58.534559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:58.535008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:58.535802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:58.536246 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:58.683377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:58.692110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f05876f5-dd7e-411f-95db-2cdb8a8e4e6e tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.169729 Jul 15 14:04:58.692723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 207/421] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:58 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:04:59.709824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:04:59.710443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:04:59.717684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:59.718132 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:59.718908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:04:59.719350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:04:59.854947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:04:59.863451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b7a3a529-d71f-428f-9a3e-e17d87a84b28 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.157468 Jul 15 14:04:59.864048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 215/422] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:04:59 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:00.880581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:00.881186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:00.888204 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:00.888684 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:00.889463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:00.889900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:01.020084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:01.030296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-14bda440-3cbf-4bc9-8214-b49b4186f576 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.153474 Jul 15 14:05:01.030927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 208/423] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:00 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:02.048311 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:02.048978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:02.055619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.056069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.056877 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.057314 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.203352 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:02.211511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c0b89bf7-471e-4d50-ac0e-043c47b1a22c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.167777 Jul 15 14:05:02.212083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 216/424] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:02 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:02.577181 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:02.580813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:02.588016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.588480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.589260 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.589691 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.667152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-823c5e08-ac5b-4f76-ac48-1623656d5cbd tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action" status: 202 len: 0 microversion: 2.1 time: 0.098567 Jul 15 14:05:02.668077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 209/425] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:05:02 2022] POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:05:02.677164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:02.677776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:02.684284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.684889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.685743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:02.686212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:02.845509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:02.853937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6815fab0-7290-41b3-b2f3-138d4a80d998 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1746 microversion: 2.1 time: 0.181007 Jul 15 14:05:02.854533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 217/426] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:02 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:03.229517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:03.230256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:03.236695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:03.237137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:03.237908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:03.238341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:03.374152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:03.383025 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5ab14dff-ef72-4587-8388-2efd68574b94 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.157580 Jul 15 14:05:03.383913 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 210/427] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:03 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:03.871028 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:03.871795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:03.879183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:03.879633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:03.880433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:03.880879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:04.025611 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:04.034952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7ac8432b-d820-4838-b476-ac0e96c637d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.167900 Jul 15 14:05:04.035523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 218/428] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:03 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:04.401403 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:04.402016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:04.409090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:04.409545 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:04.410503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:04.410963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:04.544869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:04.557807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-33b62b0b-fce2-487d-8572-8a167c3c26d1 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.160327 Jul 15 14:05:04.558390 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 211/429] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:04 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:05.053993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:05.054631 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:05.061826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:05.062277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:05.063047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:05.063483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:05.215975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:05.224365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9241cc53-66ad-4032-b4d7-0931b9b8fdcc tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.174142 Jul 15 14:05:05.224962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 219/430] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:05 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:05.575183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:05.576124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:05.582664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:05.583120 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:05.584017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:05.584470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:05.729245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:05.743261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9383047c-0562-4185-a568-ab1449c4baf3 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.171831 Jul 15 14:05:05.743781 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 212/431] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:05 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:06.242147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:06.242748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:06.245049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=50 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:06.250867 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:06.251320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:06.252084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:06.252558 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:06.402262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:06.410396 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6f9cc27a-dd03-4b63-bdd0-e1aae0b47a63 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.172085 Jul 15 14:05:06.410966 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 220/432] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:06 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:06.760599 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:06.761217 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:06.767935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:06.768412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:06.769197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:06.769640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:06.908564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:06.917485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7d780ea5-45d3-46df-ba55-49b7080c3e91 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1736 microversion: 2.1 time: 0.159997 Jul 15 14:05:06.917485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 213/433] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:06 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:07.427403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:07.427960 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:07.435073 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:07.435519 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:07.436323 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:07.436887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:07.609832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:07.617809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-aeec20b1-20e2-49e9-b61c-703c7ab83763 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.194553 Jul 15 14:05:07.618376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 221/434] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:07 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:07.934529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:07.935667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:07.943018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:07.943606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:07.944453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:07.945100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.089768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:08.093461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:08.098758 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-251a15a4-6fd6-4cb5-bea3-a07269540a8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1716 microversion: 2.1 time: 0.167973 Jul 15 14:05:08.099341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 214/435] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:07 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:08.206988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:08.207487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:08.214047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.214498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.215288 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.215727 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.303276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] HTTP exception thrown: Cannot 'detach_volume' instance f7f6876c-e419-4a62-b81a-9636359322ff while it is in vm_state rescued Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Request method failure captured: Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments/261b8e09-314b-4672-8fc5-76ebf89940c6 HTTP/1.1 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMfaDEyIKpd84FJ2rOQ-kI_5629Y6r4gp41GUtGZIm-geOXUyKUsKMXcoU7P57HGIo86Hm7353xEOOFS31dSeXFEF4MaY85UCw0yN8VosxzHvrWIAhA93C_ZofDLqqtyJh0DSi3L1UWXLrO76wmG5imMMJQi2bFxzV9q3fO2Wi7zEQ Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:05:08.304967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77c8c864a31b402880c334c39fbe5a34"}]}] Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: b86c21e37e2a49e9bdd48e15b091ce09 Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:05:08.307309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Cannot 'detach_volume' instance f7f6876c-e419-4a62-b81a-9636359322ff while it is in vm_state rescued Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'server_id': 'f7f6876c-e419-4a62-b81a-9636359322ff', 'id': '261b8e09-314b-4672-8fc5-76ebf89940c6'} Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7f6876c-e419-4a62-b81a-9636359322ff in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:05:08.308854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7f6876c-e419-4a62-b81a-9636359322ff while it is in vm_state rescued Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7f6876c-e419-4a62-b81a-9636359322ff while it is in vm_state rescued Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:08.312096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Returning 409 to user: Cannot 'detach_volume' instance f7f6876c-e419-4a62-b81a-9636359322ff while it is in vm_state rescued {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:05:08.314162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1d2f6e6e-bb95-494a-a676-5dcb3b1173ea tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments/261b8e09-314b-4672-8fc5-76ebf89940c6" status: 409 len: 152 microversion: 2.1 time: 0.103566 Jul 15 14:05:08.314162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 222/436] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:05:08 2022] DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments/261b8e09-314b-4672-8fc5-76ebf89940c6 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 14:05:08.317915 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:08.318448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:08.325681 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.326135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.326912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.327342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.402593 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4fa37b61-6fec-406d-af89-a80a3c3c2409 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/action" status: 202 len: 0 microversion: 2.1 time: 0.088325 Jul 15 14:05:08.403418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 215/437] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:05:08 2022] POST /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:05:08.412240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:08.412911 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:08.421293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.421740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.422519 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.422959 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.558224 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:08.566410 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3bf6cf06-a39b-48ae-abc5-6af4a86afb80 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1724 microversion: 2.1 time: 0.157947 Jul 15 14:05:08.566986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 223/438] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:08 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:08.636086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:08.636811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:08.643447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.643897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.644739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:08.645174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:08.794898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:08.803063 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1a8a59e6-8555-4296-8604-ad4865486d2b tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.171140 Jul 15 14:05:08.803637 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 216/439] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:08 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:09.583227 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:09.583841 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:09.590368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:09.590889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:09.591687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:09.592125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:09.720153 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:09.728079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-982d7909-89f0-4d8b-87c4-a758b2f8e080 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1724 microversion: 2.1 time: 0.148753 Jul 15 14:05:09.728673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 224/440] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:09 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:09.820433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:09.821071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:09.827843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:09.828286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:09.829086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:09.829514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:09.988793 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:09.996848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-54b7f185-c308-4c8f-b7ae-4722ec470941 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.180237 Jul 15 14:05:09.997812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 217/441] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:09 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:10.746137 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:10.746753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:10.753875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:10.754329 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:10.755108 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:10.755546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:10.883249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:10.885514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=100 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:10.893666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-328fff5c-b7c8-4fa9-825c-009f2bfdaa8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1724 microversion: 2.1 time: 0.151371 Jul 15 14:05:10.894238 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 225/442] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:10 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:11.014349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:11.014895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:11.021656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:11.022105 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:11.022870 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:11.023310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:11.167196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:11.175765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8cfe9a65-bf7b-468d-925c-d882ae0e39df tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.166007 Jul 15 14:05:11.176328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 218/443] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:11 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:11.911001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:11.911614 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:11.918729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:11.919184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:11.919987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:11.920455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:12.048858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:12.056687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-90ae2d1c-b46c-4fc1-92c9-2285798a3ee0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1730 microversion: 2.1 time: 0.149605 Jul 15 14:05:12.057239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 226/444] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:11 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:12.072836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:12.073379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:12.080219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:12.080702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:12.081462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:12.081900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:12.158115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d8533976-32a6-4d4d-8c36-c6b3579dcde0 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089024 Jul 15 14:05:12.158717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 219/445] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:05:12 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:12.193871 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:12.194521 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:12.201726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:12.202178 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:12.202962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:12.203400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:12.356348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:12.365136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-065480d3-4c64-4f83-a726-cabce4740e78 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.175162 Jul 15 14:05:12.365710 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 227/446] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:12 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:13.288254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-5bb51dbe-9282-4224-b096-6fc880aa1733 req-87b6a780-7ebb-4253-9ab1-25020e42c6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:13.302607 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5bb51dbe-9282-4224-b096-6fc880aa1733 req-87b6a780-7ebb-4253-9ab1-25020e42c6dc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:13.303054 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5bb51dbe-9282-4224-b096-6fc880aa1733 req-87b6a780-7ebb-4253-9ab1-25020e42c6dc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:13.315487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-5bb51dbe-9282-4224-b096-6fc880aa1733 req-87b6a780-7ebb-4253-9ab1-25020e42c6dc service nova] Creating event network-changed:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:05:13.320495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-5bb51dbe-9282-4224-b096-6fc880aa1733 req-87b6a780-7ebb-4253-9ab1-25020e42c6dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036502 Jul 15 14:05:13.321083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 220/447] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:05:13.381889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:13.382748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:13.389830 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:13.390471 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:13.391440 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:13.391577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:13.555336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:13.564800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d4ce02c9-0b7d-4111-a412-b80a3374dcf4 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.186660 Jul 15 14:05:13.565494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 228/448] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:13 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:14.584022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:14.584740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:14.591230 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:14.591693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:14.592526 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:14.592968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:14.740043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:14.748481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7353f887-1d3a-4bb1-be17-5a97ee98437c tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.169872 Jul 15 14:05:14.749039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 221/449] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:14 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:15.334511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-414641c6-bbff-4e1d-aaba-2108999d225d req-8833dac2-285d-4fd3-b24a-1d3649409309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:15.343572 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-414641c6-bbff-4e1d-aaba-2108999d225d req-8833dac2-285d-4fd3-b24a-1d3649409309 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:15.344010 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-414641c6-bbff-4e1d-aaba-2108999d225d req-8833dac2-285d-4fd3-b24a-1d3649409309 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:15.354697 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-414641c6-bbff-4e1d-aaba-2108999d225d req-8833dac2-285d-4fd3-b24a-1d3649409309 service nova] Creating event network-changed:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:05:15.360612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-414641c6-bbff-4e1d-aaba-2108999d225d req-8833dac2-285d-4fd3-b24a-1d3649409309 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029683 Jul 15 14:05:15.361258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 229/450] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:15.765247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:15.765955 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:15.772728 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:15.773203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:15.774012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:15.774448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:15.930764 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:15.940720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a0029c8b-7ae2-45ff-9590-b7c89bd01192 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.179785 Jul 15 14:05:15.941517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 222/451] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:15 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:16.960215 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:16.960836 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:16.967531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:16.967981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:16.968890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:16.969331 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:17.115380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:17.124366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2096fecf-feb2-465f-958c-def3bea9b34a tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.168779 Jul 15 14:05:17.125090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 230/452] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:16 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:18.142778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:18.143434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:18.150443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:18.150899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:18.151724 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:18.152470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:18.309979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:18.317970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-992c5af3-535c-488d-a330-016326611bb6 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.179240 Jul 15 14:05:18.318533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 223/453] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:18 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:19.335677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:19.336696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:19.348423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:19.348989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:19.350110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:19.350549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:19.501428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:19.509315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9aee96be-339b-45cf-bbd2-5ae52620f405 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1751 microversion: 2.1 time: 0.177954 Jul 15 14:05:19.510034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 231/454] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:19 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:20.527035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:20.527568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:20.530481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=44 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:20.535804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:20.536242 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:20.537032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:20.537517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:20.680154 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:20.688071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-91392c96-21eb-4c21-8e47-65eac008e8d1 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1754 microversion: 2.1 time: 0.164942 Jul 15 14:05:20.688667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 224/455] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:20 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:26.615469 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:26.616038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:26.623470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:26.623921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:26.624795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:26.625237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:26.653955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9fe9c107-b78f-46fe-a38d-c952030ecfec tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments/950d16f3-afbc-4198-833a-026eaa3afac8" status: 200 len: 194 microversion: 2.20 time: 0.042506 Jul 15 14:05:26.655165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 232/456] 10.222.0.16 () {60 vars in 1453 bytes} [Fri Jul 15 14:05:26 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments/950d16f3-afbc-4198-833a-026eaa3afac8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:05:26.721081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:26.721630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:26.728655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:26.729104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:26.729890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:26.730323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:26.882696 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lazy-loading 'services' on Instance uuid 2f497d21-0e38-4bee-8991-6aae2a4eae9b {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:05:27.000413 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-61da708f-7866-4958-a5d7-480ee5b134d0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments/950d16f3-afbc-4198-833a-026eaa3afac8" status: 202 len: 0 microversion: 2.20 time: 0.283690 Jul 15 14:05:27.001006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 225/457] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jul 15 14:05:26 2022] DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments/950d16f3-afbc-4198-833a-026eaa3afac8 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:05:27.009406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:27.010639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:27.016757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:27.017454 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:27.018237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:27.018878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:27.052016 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ce8203ad-71c4-496d-b08b-0be502eb5814 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046454 Jul 15 14:05:27.052624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 233/458] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jul 15 14:05:27 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:05:28.064968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.066134 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.072844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.073287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.074084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.074556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.107838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fce6774a-ce28-49cb-91ef-dfeff125bd27 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048165 Jul 15 14:05:28.108693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 226/459] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jul 15 14:05:28 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:28.172148 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.172665 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.179179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.179633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.180458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.180898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.208974 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:05:28.290955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f5aa65fc-4ffe-43cf-b029-091039fcdef5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 204 len: 0 microversion: 2.20 time: 0.122439 Jul 15 14:05:28.291574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 234/460] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jul 15 14:05:28 2022] DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 14:05:28.300325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.300880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.307885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.308328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.309126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.309559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.442765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:28.451482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:28.452930 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:28.454097 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cd7e051e-de76-4d43-a008-46dc44bfb406 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.157664 Jul 15 14:05:28.454780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 227/461] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:28 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:28.526996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.528012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.534176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.534626 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.535393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.535834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.567055 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2207071a-5ced-40c9-9d50-de57d4fd4693 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044301 Jul 15 14:05:28.567703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 235/462] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:05:28 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:05:28.632587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.633082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.639286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.639669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.640479 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.640922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.669149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:05:28.755190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-50799d4a-4217-43a1-9509-302835527be0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 204 len: 0 microversion: 2.1 time: 0.126200 Jul 15 14:05:28.755777 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 228/463] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:05:28 2022] DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:05:28.763858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:28.764502 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:28.770586 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.771040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.771811 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:28.772253 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:28.909232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:28.916819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-42c94a71-12cf-4bc0-9147-bbeb97fda0f1 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1673 microversion: 2.1 time: 0.156679 Jul 15 14:05:28.917384 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 236/464] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:28 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:29.473717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:29.474419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:29.483797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:29.484250 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:29.485069 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:29.486371 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:29.492686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:29.626492 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:29.635702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:29.637247 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:29.638422 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6bde5589-24cd-47a6-9987-bcac9d19583e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.169415 Jul 15 14:05:29.639643 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 229/465] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:29 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:29.934836 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:29.935447 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:29.942201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:29.942648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:29.943421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:29.943860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:30.101003 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:30.108971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-63fe8431-f6b0-4bd0-9096-8cca80ab8efd tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1673 microversion: 2.1 time: 0.177722 Jul 15 14:05:30.109544 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 237/466] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:29 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:30.657568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:30.658192 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:30.664790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:30.665232 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:30.665993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:30.666420 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:30.801306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:30.809468 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:30.811549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:30.812749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1b2c5cc9-3bb4-4551-bbd6-ee28fca40994 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.159048 Jul 15 14:05:30.813306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 230/467] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:30 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:31.126240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:31.126850 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:31.133502 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:31.133952 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:31.134729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:31.135172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:31.273938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:31.282824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4d507dd2-4653-447a-9c62-f2f2ca87c919 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1673 microversion: 2.1 time: 0.160307 Jul 15 14:05:31.283371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 238/468] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:31 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:31.831064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:31.831701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:31.838225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:31.838678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:31.839491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:31.840146 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:31.974594 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:31.983004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:31.984797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:31.985931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-77376df2-054d-4db8-8009-b9cb61907d9d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1722 microversion: 2.20 time: 0.159389 Jul 15 14:05:31.986476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 231/469] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:31 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:32.304076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:32.305915 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:32.315938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:32.316734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:32.318098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:32.318836 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:32.475211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:32.485407 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9eee19ab-44fd-4dff-93b5-671d3232389f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1673 microversion: 2.1 time: 0.187071 Jul 15 14:05:32.485984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 239/470] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:32 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:33.008773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:33.009476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:33.016584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:33.017037 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:33.017830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:33.018269 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:33.102400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:33.115970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:33.117615 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:33.119275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-850a2f13-604c-42ef-a12b-c89943557f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1654 microversion: 2.20 time: 0.119120 Jul 15 14:05:33.119624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 232/471] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:32 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1654 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:33.519335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:33.519962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:33.528906 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:33.530083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:33.531089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:33.531671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:33.600451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:33.609541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f7e95631-c58f-4b9c-bd8d-df0da787b877 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1605 microversion: 2.1 time: 0.094311 Jul 15 14:05:33.610249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 240/472] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:33 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1605 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:33.794830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-2f5e40a3-ecbe-4e9a-9d99-48b881d541ca req-83dc9843-823d-439a-a1cc-171c613cf887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f497d21-0e38-4bee-8991-6aae2a4eae9b", "name": "network-vif-deleted", "tag": "22523bdd-1c81-4c9c-88e3-9d6496dfb8b9"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:33.809353 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-2f5e40a3-ecbe-4e9a-9d99-48b881d541ca req-83dc9843-823d-439a-a1cc-171c613cf887 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:33.810834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-2f5e40a3-ecbe-4e9a-9d99-48b881d541ca req-83dc9843-823d-439a-a1cc-171c613cf887 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:33.842909 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-2f5e40a3-ecbe-4e9a-9d99-48b881d541ca req-83dc9843-823d-439a-a1cc-171c613cf887 service nova] Creating event network-vif-deleted:22523bdd-1c81-4c9c-88e3-9d6496dfb8b9 for instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b on hv-cinder-85000 Jul 15 14:05:33.860832 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-2f5e40a3-ecbe-4e9a-9d99-48b881d541ca req-83dc9843-823d-439a-a1cc-171c613cf887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069555 Jul 15 14:05:33.861466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 233/473] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:34.145320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:34.146796 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:34.166743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.169041 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.170908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.172023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.209340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:34.249515 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.250279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.251080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lazy-loading 'fault' on Instance uuid 2f497d21-0e38-4bee-8991-6aae2a4eae9b {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:05:34.324120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:34.340119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:34.343573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:34.345817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a0dcb866-c525-4a66-bd6f-d17f33d59645 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 200 len: 1371 microversion: 2.20 time: 0.209493 Jul 15 14:05:34.347259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 241/474] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:34 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:34.628143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:34.629675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:34.636716 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.637541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.638564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.639381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.740562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:34.742941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:34.754667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lazy-loading 'fault' on Instance uuid 4a543a41-bbbc-4c3a-833a-903faa97dde7 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:05:34.875366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:34.885967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b2d8dcb9-9d98-408d-b3bb-ffb7d020a710 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 200 len: 1327 microversion: 2.1 time: 0.262466 Jul 15 14:05:34.887766 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 234/475] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:34 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 1327 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:35.365939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:35.366562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:35.375191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:35.375657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:35.376473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:35.377071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:35.394696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b HTTP/1.1 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:05:35.396380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:05:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '2f497d21-0e38-4bee-8991-6aae2a4eae9b'} Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:05:35.401097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:05:35.404291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.406648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:05:35.406648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e401f8cb-b438-4b12-ab8d-2b14be4a7a98 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 404 len: 111 microversion: 2.20 time: 0.036036 Jul 15 14:05:35.406648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 242/476] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:35 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:05:35.407393 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8cc97e05-a143-419f-80d6-f9d139e9a6aa tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '.version_select at 0x7fa0c10b9160>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:35.432032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8cc97e05-a143-419f-80d6-f9d139e9a6aa tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633826667" status: 204 len: 0 microversion: 2.20 time: 0.027667 Jul 15 14:05:35.437903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 235/477] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Jul 15 14:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633826667 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 14:05:35.901395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-7c995f51-df56-4325-b9f2-09167b1aeffb req-e959c334-a067-4079-991e-5261fa4a2392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a543a41-bbbc-4c3a-833a-903faa97dde7", "name": "network-vif-deleted", "tag": "88f82e49-8214-4511-9860-93f14cc42d7e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:35.906583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:35.908132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:35.911405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-7c995f51-df56-4325-b9f2-09167b1aeffb req-e959c334-a067-4079-991e-5261fa4a2392 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:35.912081 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-7c995f51-df56-4325-b9f2-09167b1aeffb req-e959c334-a067-4079-991e-5261fa4a2392 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:35.916281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:35.917434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:35.918539 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:35.919251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:35.929431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-7c995f51-df56-4325-b9f2-09167b1aeffb req-e959c334-a067-4079-991e-5261fa4a2392 service nova] Creating event network-vif-deleted:88f82e49-8214-4511-9860-93f14cc42d7e for instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 on hv-cinder-85000 Jul 15 14:05:35.937083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-7c995f51-df56-4325-b9f2-09167b1aeffb req-e959c334-a067-4079-991e-5261fa4a2392 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039385 Jul 15 14:05:35.938046 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 243/478] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:35.940198 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 HTTP/1.1 Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:05:35.942074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:05:35.943487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '4a543a41-bbbc-4c3a-833a-903faa97dde7'} Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:05:35.944454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:05:35.945667 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:35.946725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:05:35.946725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cdd87544-0f6b-4fe5-935f-49cc3b984ee4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 404 len: 111 microversion: 2.1 time: 0.041889 Jul 15 14:05:35.946725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 236/479] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:35 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:05:35.957880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-01d522de-748a-4775-8e9e-e82fc596eaa6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '.version_select at 0x7fa0c11f3550>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:35.985286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-01d522de-748a-4775-8e9e-e82fc596eaa6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476701512" status: 202 len: 0 microversion: 2.1 time: 0.033243 Jul 15 14:05:35.986654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 244/480] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jul 15 14:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476701512 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 14:05:36.437560 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-795442bf-119c-4b4c-92c5-b13cde2dc70e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: .version_select at 0x7fa0c11d43a0>, body: {"keypair": {"name": "tempest-keypair-615591891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX2qd39i8cBVHboX1OBw0Si5fFCgiRG/mFYPr4B7rkSPWCjQRaCckikt5jV76kmjbRwlJM0/CiiSuSV5kiBIqJHsmxoPPCuE5kYFF+BjddXaOzfcPEAhrjDiGxIu24CpQ=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:36.466059 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-795442bf-119c-4b4c-92c5-b13cde2dc70e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for project c160b9f06dad4ee98349dbc63131c20d. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:05:36.474996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-795442bf-119c-4b4c-92c5-b13cde2dc70e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for user 520583af1f264f22a86722b0cb9ff405 and project c160b9f06dad4ee98349dbc63131c20d. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:05:36.512922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-795442bf-119c-4b4c-92c5-b13cde2dc70e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.084168 Jul 15 14:05:36.514249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 237/481] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Jul 15 14:05:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 15 14:05:37.340924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a98e723f-e87a-446b-9cba-f082cb58abf3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: .version_select at 0x7fa0c11691f0>, body: {"keypair": {"name": "tempest-keypair-1850153713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtxatq2u06dP+f9DmIqwFGETNr8Fvxr/BXVkINb5kGQImAFD/DQbpe/A48V48c5viuSTR72vbMmPu/AF0q7sH+s8X0Y8Sn5UFzhE5cBZkFv7rvUWKGt3826ZWhyQoLu8g=="}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:37.346571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:37.362559 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-a98e723f-e87a-446b-9cba-f082cb58abf3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:05:37.368695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-a98e723f-e87a-446b-9cba-f082cb58abf3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for user 96d4c389c4da4d2188e8a32e5ed1be7d and project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:05:37.402728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a98e723f-e87a-446b-9cba-f082cb58abf3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065897 Jul 15 14:05:37.404131 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 245/482] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:05:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:38.692528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1383101539", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68380afb-92df-4e5a-adc7-5f1834064646"}], "security_groups": [{"name": "tempest-securitygroup--974095970"}], "key_name": "tempest-keypair-615591891", "user_data": "}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:38.861416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] validate_networks() for [('68380afb-92df-4e5a-adc7-5f1834064646', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:05:39.650822 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-997797694", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0460551c-e776-41db-9da0-199d4897f65f"}], "security_groups": [{"name": "tempest-securitygroup--396120793"}], "key_name": "tempest-keypair-1850153713", "user_data": "}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:39.661133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:05:39.661899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:05:39.662550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:05:39.663059 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:05:39.663702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:05:39.674144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:39.674592 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:39.675402 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:39.675851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:39.695277 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for project c160b9f06dad4ee98349dbc63131c20d. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:05:39.700694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Getting quotas for user 520583af1f264f22a86722b0cb9ff405 and project c160b9f06dad4ee98349dbc63131c20d. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:05:39.720006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:05:39.723086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:05:39.801122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] validate_networks() for [('0460551c-e776-41db-9da0-199d4897f65f', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:05:39.806529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ecb8dd87-b1c1-4a8d-a2d5-7312d9383014 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.119102 Jul 15 14:05:39.807458 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 238/483] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jul 15 14:05:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 14:05:39.824874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:39.826931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:39.930611 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:39.943290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:39.946575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:39.949085 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3c54af66-9319-4507-9146-ddd1f29c893d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1281 microversion: 2.20 time: 0.133541 Jul 15 14:05:39.949932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 239/484] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:39 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:05:40.399980 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:05:40.400379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:05:40.400892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:05:40.401295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:05:40.401739 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:05:40.415797 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:40.416272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:40.417101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:40.417547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:40.439725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:05:40.444342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Getting quotas for user 96d4c389c4da4d2188e8a32e5ed1be7d and project c8778d5da3de4c4dbae5d24842b359bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:05:40.457676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:05:40.460318 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:05:40.512140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-50214b67-47d2-40d3-92af-ad6166af2dc2 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.870998 Jul 15 14:05:40.512838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 246/485] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:05:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:05:40.524229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-79c5aebf-ea77-4b0a-af35-65b3e424fba3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:40.524880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-79c5aebf-ea77-4b0a-af35-65b3e424fba3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:40.603662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-79c5aebf-ea77-4b0a-af35-65b3e424fba3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:40.613731 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-79c5aebf-ea77-4b0a-af35-65b3e424fba3 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1237 microversion: 2.1 time: 0.093271 Jul 15 14:05:40.614865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 240/486] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:40 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:40.976215 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:40.976854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:40.984721 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:40.985172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:40.985962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:40.986396 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:41.099336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:41.114769 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:41.116655 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:41.118324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a300a0fe-aed6-4110-ae82-7477bb991c45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1333 microversion: 2.20 time: 0.149471 Jul 15 14:05:41.119699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 247/487] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:40 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:41.640979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:41.642377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:41.650734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:41.651559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:41.652648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:41.653324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:41.749327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:41.764144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f1cbdd01-0e3a-4439-85ac-d7b6786fe3b6 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1289 microversion: 2.1 time: 0.127171 Jul 15 14:05:41.765171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 241/488] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:41 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:42.140254 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:42.141240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:42.150261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:42.150827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:42.151754 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:42.152434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:42.376949 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:42.393151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:42.396851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:42.399098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ec698af4-1e58-4497-b371-d60075ed9070 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.264495 Jul 15 14:05:42.400934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 248/489] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:42 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:42.791946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:42.792917 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:42.802267 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:42.802930 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:42.804112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:42.805086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:42.896455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:42.910666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-04356e11-136f-4ea2-951c-c692ea4b35e0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1295 microversion: 2.1 time: 0.122772 Jul 15 14:05:42.911715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 242/490] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:42 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:43.431716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:43.432576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:43.452767 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:43.465359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:43.466844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:43.467655 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:43.722018 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:43.749279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:43.753247 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:43.756027 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-89a25374-d30f-4cee-90f7-53430ab06648 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.329660 Jul 15 14:05:43.764622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 249/491] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:43 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:05:43.939706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:43.940595 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:43.952335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:43.953368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:43.955093 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:43.956035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:44.012533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-5cef4886-6ce6-47a5-9e41-0ff57d255606 req-54cdc441-aae3-4cff-9e36-81df2ba8c99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:44.036003 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-5cef4886-6ce6-47a5-9e41-0ff57d255606 req-54cdc441-aae3-4cff-9e36-81df2ba8c99e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:44.037244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-5cef4886-6ce6-47a5-9e41-0ff57d255606 req-54cdc441-aae3-4cff-9e36-81df2ba8c99e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:44.093958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-5cef4886-6ce6-47a5-9e41-0ff57d255606 req-54cdc441-aae3-4cff-9e36-81df2ba8c99e service nova] Creating event network-changed:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:05:44.103238 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-5cef4886-6ce6-47a5-9e41-0ff57d255606 req-54cdc441-aae3-4cff-9e36-81df2ba8c99e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097043 Jul 15 14:05:44.106943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 250/492] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:44.163446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:44.175416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e62c9bce-fe9d-4e1c-84cf-226b83ddd453 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.241493 Jul 15 14:05:44.176013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 243/493] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:43 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:44.785255 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:44.787778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:44.801992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:44.803001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:44.804576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:44.805360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.033502 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:45.048223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:45.051294 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:45.053475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b48e5ea0-a229-4049-89e4-9990e431a827 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.280408 Jul 15 14:05:45.054489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 251/494] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:44 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:45.199015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:45.199662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:45.207865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.208416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.209322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.209831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.385645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:45.395046 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-42806d64-6439-4c2e-bd19-bf666f90fc1d tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.199981 Jul 15 14:05:45.395655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 244/495] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:45 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:45.704900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:45.705790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:45.716526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.717942 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.719336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.719949 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.839040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lazy-loading 'services' on Instance uuid f7f6876c-e419-4a62-b81a-9636359322ff {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:05:45.934034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2ef039a1-1e44-4610-88e3-5d73cebf9117 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments/261b8e09-314b-4672-8fc5-76ebf89940c6" status: 202 len: 0 microversion: 2.1 time: 0.236652 Jul 15 14:05:45.935141 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 252/496] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:05:45 2022] DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments/261b8e09-314b-4672-8fc5-76ebf89940c6 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:05:45.944944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:45.946849 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:45.957535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.958329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:45.959500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:45.960101 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.008652 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-385e4c40-9ea9-4c32-93ee-36c89a80ce57 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068260 Jul 15 14:05:46.009243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 245/497] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:05:45 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:46.077545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:46.078358 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:46.085462 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:46.085921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.086703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:46.087137 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.128129 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-78fcfa6e-2928-4315-9324-374d1970fd5f req-5d7dd7c5-3718-435f-a42d-b80a8d229617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fa1bf5-3ff3-468a-bc34-6bb3a90494a4", "tag": "815bc904-57dc-4545-9f06-3e6e84c15272"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:46.137387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-78fcfa6e-2928-4315-9324-374d1970fd5f req-5d7dd7c5-3718-435f-a42d-b80a8d229617 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:46.137967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-78fcfa6e-2928-4315-9324-374d1970fd5f req-5d7dd7c5-3718-435f-a42d-b80a8d229617 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.152333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-78fcfa6e-2928-4315-9324-374d1970fd5f req-5d7dd7c5-3718-435f-a42d-b80a8d229617 service nova] Creating event network-changed:815bc904-57dc-4545-9f06-3e6e84c15272 for instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 on hv-cinder-85000 Jul 15 14:05:46.164992 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-78fcfa6e-2928-4315-9324-374d1970fd5f req-5d7dd7c5-3718-435f-a42d-b80a8d229617 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038342 Jul 15 14:05:46.164992 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 246/498] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:05:46.265545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:46.275684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:46.277255 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:46.278414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a5abd627-9f5b-4574-937a-8c94ac62dd44 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.205969 Jul 15 14:05:46.278987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 253/499] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:46 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:46.417834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:46.418813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:46.430399 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:46.431080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.432477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:46.433083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:46.635532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:46.643830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a56431a2-482e-439c-b248-6fdd3c844b53 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.234478 Jul 15 14:05:46.644431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 247/500] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:46 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:47.024210 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:47.025421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:47.040982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.041435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.042674 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.043382 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.092590 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8c684993-489c-410e-a856-d1ea655e5f8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073277 Jul 15 14:05:47.093210 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 254/501] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:05:47 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:05:47.184841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:47.185490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:47.192187 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.192721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.193565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.194048 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.231686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:05:47.297487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:47.298582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:47.308265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.309032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.310348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.311084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.328828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-61de02e4-116b-45c6-a916-5968d1fec6d8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 204 len: 0 microversion: 2.1 time: 0.147300 Jul 15 14:05:47.331807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 248/502] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:05:47 2022] DELETE /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:05:47.344072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:47.345251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:47.355465 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.356162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.357450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.358167 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.532207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:47.544958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:47.548272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:47.550840 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9972b4dd-31d6-4e7d-bcf1-386d0d97049c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.258309 Jul 15 14:05:47.552163 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 255/503] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:47 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:05:47.568154 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:47.577484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ed1dbb72-2bc6-4279-b6b2-f15ada6b946f tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1690 microversion: 2.1 time: 0.241205 Jul 15 14:05:47.578249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 249/504] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:47 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:47.661376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:47.662181 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:47.669329 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.669782 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.670795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:47.671246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:47.848928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:47.859712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-2b259a4e-3cf8-4cc7-b317-41c971db7883 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.202758 Jul 15 14:05:47.860340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 256/505] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:47 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:48.574074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:48.574928 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:48.582410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.582861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:48.583655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.584093 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:48.597365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:48.598399 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:48.605855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:48.607368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.607894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:48.609040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.609479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:48.842344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:48.853191 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:48.855006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:48.856380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6791eac7-a00b-4f58-8f15-ad0ddc1e3b59 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.286605 Jul 15 14:05:48.857248 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 250/506] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:48 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:05:48.862153 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:48.875550 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3eb209cc-819c-4edc-8e0d-54fb3337f003 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1690 microversion: 2.1 time: 0.282485 Jul 15 14:05:48.876894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 257/507] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:48 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1690 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:48.879062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:48.879891 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:48.882225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:48.890135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.890742 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:48.891836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:48.892368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:49.071411 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:49.081441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c3d95836-af29-480f-8fc7-598be5639ef0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.207064 Jul 15 14:05:49.082089 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 251/508] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:48 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:49.876266 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:49.877049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:49.884457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:49.884918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:49.885734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:49.886174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:49.905256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:49.906749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:49.911352 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:49.923147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:49.924206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:49.925779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:49.926851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:50.132776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:50.152569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:50.156618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:50.158995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bd3178ea-549a-4d0e-a8b1-2472edfd0282 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.286554 Jul 15 14:05:50.162809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:50.172376 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6bdc4159-34ae-4995-bf50-87edd6402284 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1690 microversion: 2.1 time: 0.275564 Jul 15 14:05:50.173364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 258/509] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:49 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:50.173567 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 252/510] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:49 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1690 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:50.178912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-3897616a-0fed-484c-9238-1aab65d1d5f9 req-8f73b43e-a9a9-41cd-8bc0-8a5993115d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "name": "network-vif-plugged", "status": "completed", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:50.187722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3897616a-0fed-484c-9238-1aab65d1d5f9 req-8f73b43e-a9a9-41cd-8bc0-8a5993115d5d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:50.188338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3897616a-0fed-484c-9238-1aab65d1d5f9 req-8f73b43e-a9a9-41cd-8bc0-8a5993115d5d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:50.190919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:50.192234 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:50.200717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-3897616a-0fed-484c-9238-1aab65d1d5f9 req-8f73b43e-a9a9-41cd-8bc0-8a5993115d5d service nova] Creating event network-vif-plugged:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:05:50.203904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:50.204555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:50.205629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:50.206348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:50.206872 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-3897616a-0fed-484c-9238-1aab65d1d5f9 req-8f73b43e-a9a9-41cd-8bc0-8a5993115d5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Jul 15 14:05:50.207674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 253/511] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:50.395795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:50.409251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-725a78c9-5b8a-40aa-8d8d-61bab71e62eb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.233573 Jul 15 14:05:50.410275 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 259/512] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:50 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:51.185055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=14 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:51.190761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:51.191792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:51.192373 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:51.193112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:51.195767 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:51.196781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=10 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:51.199690 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.200150 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.201585 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.202036 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.206815 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.207509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.208800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.209479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.459471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:51.468137 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:51.471056 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:51.473766 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:51.475161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4a11be81-0358-4094-8e7f-149cb451e69b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.291132 Jul 15 14:05:51.475761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 254/513] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:51 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:51.487279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-985c09de-f8ae-4b84-81ce-635ada5d6f8d tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1690 microversion: 2.1 time: 0.295496 Jul 15 14:05:51.487279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 260/514] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:51 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1690 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:51.493936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:51.495455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:51.505858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.506670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.507993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:51.508754 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:51.729170 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:51.732778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:05:51.748652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3e7f94b7-e2da-4cb9-9ab9-59d6fcc6db17 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.260919 Jul 15 14:05:51.753375 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 261/515] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:51 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:52.238920 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-e1cf9cef-0b41-4959-b875-3587ba900537 req-81904c7a-c5ec-441a-9c23-b1e2c702131b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fa1bf5-3ff3-468a-bc34-6bb3a90494a4", "name": "network-vif-plugged", "status": "completed", "tag": "815bc904-57dc-4545-9f06-3e6e84c15272"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:52.255497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-e1cf9cef-0b41-4959-b875-3587ba900537 req-81904c7a-c5ec-441a-9c23-b1e2c702131b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.256497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-e1cf9cef-0b41-4959-b875-3587ba900537 req-81904c7a-c5ec-441a-9c23-b1e2c702131b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.275094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-e1cf9cef-0b41-4959-b875-3587ba900537 req-81904c7a-c5ec-441a-9c23-b1e2c702131b service nova] Creating event network-vif-plugged:815bc904-57dc-4545-9f06-3e6e84c15272 for instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 on hv-cinder-85000 Jul 15 14:05:52.282286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-e1cf9cef-0b41-4959-b875-3587ba900537 req-81904c7a-c5ec-441a-9c23-b1e2c702131b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048948 Jul 15 14:05:52.282917 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 255/516] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:05:52.497492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:52.498807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:52.506926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:52.508178 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:52.511310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.512052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.513639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.514378 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.519470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.520196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.521525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.522248 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.647694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:52.669949 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6e8d7208-6de5-4854-928d-bc6e3251fe8b tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1623 microversion: 2.1 time: 0.169838 Jul 15 14:05:52.672726 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 256/517] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:52 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1623 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:52.766525 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:52.775471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:52.776862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:52.786173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:52.790631 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.791802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.791950 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:52.793554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:52.794956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:52.796196 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-56ae4476-58d9-4ffb-be56-fa7d65efd2a5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1406 microversion: 2.20 time: 0.302984 Jul 15 14:05:52.798482 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 262/518] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:52 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:53.002820 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:53.016973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c3191803-d33c-4e2d-9fe5-fe35fa0ee3d5 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.247669 Jul 15 14:05:53.020446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 257/519] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:52 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:53.227498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-447193e3-793b-4267-9828-d506846c01e2 req-5b99d1d6-4462-40a5-8e7a-0706256f7d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f6876c-e419-4a62-b81a-9636359322ff", "name": "network-vif-deleted", "tag": "5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:53.237190 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-447193e3-793b-4267-9828-d506846c01e2 req-5b99d1d6-4462-40a5-8e7a-0706256f7d72 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.237602 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-447193e3-793b-4267-9828-d506846c01e2 req-5b99d1d6-4462-40a5-8e7a-0706256f7d72 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:53.250832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-447193e3-793b-4267-9828-d506846c01e2 req-5b99d1d6-4462-40a5-8e7a-0706256f7d72 service nova] Creating event network-vif-deleted:5be1e5f3-2d5d-48b8-a6f6-aa79abf398e7 for instance f7f6876c-e419-4a62-b81a-9636359322ff on hv-cinder-85000 Jul 15 14:05:53.256309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-447193e3-793b-4267-9828-d506846c01e2 req-5b99d1d6-4462-40a5-8e7a-0706256f7d72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Jul 15 14:05:53.257124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 263/520] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:05:53.696275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:53.697127 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:53.704802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.705223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:53.706141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.707051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:53.743682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.744137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:53.744713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lazy-loading 'fault' on Instance uuid f7f6876c-e419-4a62-b81a-9636359322ff {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:05:53.790800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:53.801894 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-39396178-280b-4929-a3f7-7ee8ebf976de tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 200 len: 1336 microversion: 2.1 time: 0.109874 Jul 15 14:05:53.802720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 258/521] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:53 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:53.834596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:53.837062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:53.849745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.850659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:53.852109 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:53.853214 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.038725 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:54.039925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:54.052935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.053497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.055015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.055903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.191317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:54.206904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:54.209108 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:54.210883 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-15b91ea7-4600-4271-873b-3b0499889ff8 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1598 microversion: 2.20 time: 0.384065 Jul 15 14:05:54.219605 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 264/522] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:05:53 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1598 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:05:54.239324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:54.240197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:54.251886 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.252773 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.254514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.254743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.331472 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:54.340042 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-575a46a6-bc53-4fb6-99f9-3c5b3c52a79b tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1362 microversion: 2.1 time: 0.308325 Jul 15 14:05:54.340929 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 259/523] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:54 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:05:54.392002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fe0d8fe5-cdb4-49c0-a084-06d7895976e0 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160747 Jul 15 14:05:54.393276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 265/524] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jul 15 14:05:54 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 14:05:54.823206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:54.825002 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: f7f6876c-e419-4a62-b81a-9636359322ff] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:54.834768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.835918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.837524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:54.838227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:54.857976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] HTTP exception thrown: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Request method failure captured: Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff HTTP/1.1 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMfaDEyIKpd84FJ2rOQ-kI_5629Y6r4gp41GUtGZIm-geOXUyKUsKMXcoU7P57HGIo86Hm7353xEOOFS31dSeXFEF4MaY85UCw0yN8VosxzHvrWIAhA93C_ZofDLqqtyJh0DSi3L1UWXLrO76wmG5imMMJQi2bFxzV9q3fO2Wi7zEQ Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:05:54.860658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77c8c864a31b402880c334c39fbe5a34"}]}] Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: b86c21e37e2a49e9bdd48e15b091ce09 Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. Jul 15 14:05:54.863450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'f7f6876c-e419-4a62-b81a-9636359322ff'} Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:05:54.864907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. Jul 15 14:05:54.867382 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:05:54.870575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Returning 404 to user: Instance f7f6876c-e419-4a62-b81a-9636359322ff could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:05:54.871982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d035cc8e-a889-418a-a372-113b19a36217 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff" status: 404 len: 111 microversion: 2.1 time: 0.055074 Jul 15 14:05:54.872868 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 260/525] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:54 2022] GET /compute/v2.1/servers/f7f6876c-e419-4a62-b81a-9636359322ff => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:05:54.887986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d5f3ed73-ac31-4f28-8ee6-f25f343747e7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '.version_select at 0x7fa0c1b1cca0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:54.922122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d5f3ed73-ac31-4f28-8ee6-f25f343747e7 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331717675" status: 202 len: 0 microversion: 2.1 time: 0.043043 Jul 15 14:05:54.928108 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 266/526] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jul 15 14:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331717675 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:05:55.366017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:55.368643 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:55.383428 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:55.385083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:55.386301 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:55.387371 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:55.653186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:55.663106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a2291240-f47d-41d7-91bf-ef023d484fdb tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1548 microversion: 2.1 time: 0.307076 Jul 15 14:05:55.664079 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 261/527] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:55 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1548 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:05:55.681224 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:55.681927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:55.689889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:55.690379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:55.691425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:55.691873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:55.792370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-983421c7-654c-4c13-aa9b-14ae65348531 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115547 Jul 15 14:05:55.793254 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 267/528] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:05:55 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:56.038759 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-3bd1cd2c-10b6-4feb-9d4d-be5685c110d6 req-2c62a309-a20f-4d5b-8a26-a6d6ef6658ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:56.051137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3bd1cd2c-10b6-4feb-9d4d-be5685c110d6 req-2c62a309-a20f-4d5b-8a26-a6d6ef6658ca service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:56.052151 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3bd1cd2c-10b6-4feb-9d4d-be5685c110d6 req-2c62a309-a20f-4d5b-8a26-a6d6ef6658ca service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:56.068705 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-3bd1cd2c-10b6-4feb-9d4d-be5685c110d6 req-2c62a309-a20f-4d5b-8a26-a6d6ef6658ca service nova] Creating event network-changed:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:05:56.074637 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-3bd1cd2c-10b6-4feb-9d4d-be5685c110d6 req-2c62a309-a20f-4d5b-8a26-a6d6ef6658ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039752 Jul 15 14:05:56.075495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 262/529] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:57.419174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-0f58041b-86db-4d66-977f-f3c6e38d5a1a req-f33a7ece-611a-41e6-8032-db257ae76dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fa1bf5-3ff3-468a-bc34-6bb3a90494a4", "tag": "815bc904-57dc-4545-9f06-3e6e84c15272"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:05:57.428117 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0f58041b-86db-4d66-977f-f3c6e38d5a1a req-f33a7ece-611a-41e6-8032-db257ae76dc4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:57.428908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0f58041b-86db-4d66-977f-f3c6e38d5a1a req-f33a7ece-611a-41e6-8032-db257ae76dc4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:57.443520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-0f58041b-86db-4d66-977f-f3c6e38d5a1a req-f33a7ece-611a-41e6-8032-db257ae76dc4 service nova] Creating event network-changed:815bc904-57dc-4545-9f06-3e6e84c15272 for instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 on hv-cinder-85000 Jul 15 14:05:57.448990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-0f58041b-86db-4d66-977f-f3c6e38d5a1a req-f33a7ece-611a-41e6-8032-db257ae76dc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034035 Jul 15 14:05:57.450150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 268/530] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:05:58.922746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:58.923703 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:58.931508 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:58.932007 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:58.932954 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:58.933481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:58.965518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:05:59.080756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6f6d838b-e235-45d4-996e-3016f4b68854 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 204 len: 0 microversion: 2.1 time: 0.163267 Jul 15 14:05:59.081464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 263/531] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:05:58 2022] DELETE /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:05:59.093274 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:05:59.094409 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:05:59.101831 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:59.102292 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:59.103098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:05:59.103546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:05:59.255165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:05:59.263343 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6ffa0fe8-4e4b-48c9-a343-30c02b63a070 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1506 microversion: 2.1 time: 0.176323 Jul 15 14:05:59.263938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 269/532] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:05:59 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:00.280951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:00.281660 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:00.288868 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:00.289327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:00.290140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:00.290611 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:00.558714 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:00.568137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-eeb49c96-9167-4b5e-9e94-d3ed21d0f960 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1506 microversion: 2.1 time: 0.291420 Jul 15 14:06:00.568785 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 264/533] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:00 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:01.587713 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:01.588448 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:01.595823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:01.596283 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:01.597104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:01.597708 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:01.748419 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:01.757630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1b061f18-439c-4a63-9356-8a88e9997518 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 200 len: 1506 microversion: 2.1 time: 0.174694 Jul 15 14:06:01.758249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 270/534] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:01 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:01.890397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-93656463-47a9-44fa-91f4-6fd3b133593e req-e13ce01e-52e5-45b5-846c-e12265932700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bc879c-c169-47cb-a214-86d5850a55ec", "name": "network-vif-deleted", "tag": "0861b4f1-fb2d-42f9-b72b-e415301f1546"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:01.903740 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-93656463-47a9-44fa-91f4-6fd3b133593e req-e13ce01e-52e5-45b5-846c-e12265932700 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:01.905547 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-93656463-47a9-44fa-91f4-6fd3b133593e req-e13ce01e-52e5-45b5-846c-e12265932700 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:01.919057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-93656463-47a9-44fa-91f4-6fd3b133593e req-e13ce01e-52e5-45b5-846c-e12265932700 service nova] Creating event network-vif-deleted:0861b4f1-fb2d-42f9-b72b-e415301f1546 for instance 89bc879c-c169-47cb-a214-86d5850a55ec on hv-cinder-85000 Jul 15 14:06:01.924268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-93656463-47a9-44fa-91f4-6fd3b133593e req-e13ce01e-52e5-45b5-846c-e12265932700 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039080 Jul 15 14:06:01.924927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 265/535] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:02.590392 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-933203842"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:02.591023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:02.597617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.598052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.598821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.599247 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.735503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.network.security_group_api [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Removing security group 71f6ad5b-4ef7-45b8-b2e7-46313016c14d from port 01da8f8b-bf3b-4832-a1ec-c52703b5ed24 Jul 15 14:06:02.780857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:02.781569 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 89bc879c-c169-47cb-a214-86d5850a55ec] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:02.788800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.789241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.790034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.790491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.805026 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] HTTP exception thrown: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Request method failure captured: Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec HTTP/1.1 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMfaDEyIKpd84FJ2rOQ-kI_5629Y6r4gp41GUtGZIm-geOXUyKUsKMXcoU7P57HGIo86Hm7353xEOOFS31dSeXFEF4MaY85UCw0yN8VosxzHvrWIAhA93C_ZofDLqqtyJh0DSi3L1UWXLrO76wmG5imMMJQi2bFxzV9q3fO2Wi7zEQ Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:06:02.806700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77c8c864a31b402880c334c39fbe5a34"}]}] Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: b86c21e37e2a49e9bdd48e15b091ce09 Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. Jul 15 14:06:02.808341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '89bc879c-c169-47cb-a214-86d5850a55ec'} Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:06:02.809397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. Jul 15 14:06:02.810976 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:02.812701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Returning 404 to user: Instance 89bc879c-c169-47cb-a214-86d5850a55ec could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:06:02.812701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a6265918-5f07-4617-99c2-18b2fa58fac8 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec" status: 404 len: 111 microversion: 2.1 time: 0.034787 Jul 15 14:06:02.812701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 266/536] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:02 2022] GET /compute/v2.1/servers/89bc879c-c169-47cb-a214-86d5850a55ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:06:02.823683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:02.824181 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:02.830507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.830963 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.831748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.832186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.862654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:06:02.912252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:02.951264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c4916cf8-fa68-4a3e-968e-65c71d32de8c tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 204 len: 0 microversion: 2.1 time: 0.137863 Jul 15 14:06:02.954972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 267/537] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:06:02 2022] DELETE /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 14:06:02.960859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:02.961564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:02.968421 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.968880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:02.969670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:02.970127 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:03.158484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4f1aec6f-1ec8-4af6-9dfc-b0495ddc4475 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action" status: 202 len: 0 microversion: 2.1 time: 0.571604 Jul 15 14:06:03.162517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 271/538] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:06:02 2022] POST /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:06:03.193140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-97917e11-f078-462d-89cf-c919afb763d3 req-2b7bcaef-671b-4a86-bc3e-c3bef7cc7e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:03.236962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-97917e11-f078-462d-89cf-c919afb763d3 req-2b7bcaef-671b-4a86-bc3e-c3bef7cc7e23 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:03.238237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-97917e11-f078-462d-89cf-c919afb763d3 req-2b7bcaef-671b-4a86-bc3e-c3bef7cc7e23 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:03.274146 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:03.286364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-97917e11-f078-462d-89cf-c919afb763d3 req-2b7bcaef-671b-4a86-bc3e-c3bef7cc7e23 service nova] Creating event network-changed:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:06:03.294149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bc657bc3-ddfb-4010-9491-dc7cea799ccd tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.337397 Jul 15 14:06:03.296723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 268/539] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:02 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:03.300273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-97917e11-f078-462d-89cf-c919afb763d3 req-2b7bcaef-671b-4a86-bc3e-c3bef7cc7e23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125467 Jul 15 14:06:03.304671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 272/540] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:04.313449 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:04.314062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:04.320109 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.320605 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.321387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.321818 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.401728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:04.402951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:04.414118 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.414729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.415510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.415955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.521461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lazy-loading 'services' on Instance uuid 0e79925f-bce9-485b-8ecb-008b21cc14fd {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:06:04.532001 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:04.539700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d83b1d49-b7e2-4e2a-abad-c2103cabd318 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.230373 Jul 15 14:06:04.544435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 269/541] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:04 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:06:04.599855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8a725779-3c7d-4b46-8ccc-29a43a8df331 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments/46cf7590-0e2a-4a50-9094-102ea958f568" status: 202 len: 0 microversion: 2.1 time: 0.203265 Jul 15 14:06:04.601298 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 273/542] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:06:04 2022] DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments/46cf7590-0e2a-4a50-9094-102ea958f568 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:06:04.609463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:04.610478 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:04.616903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.617942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.618914 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:04.619425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:04.651174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d22008f6-f037-4a4c-ae8d-5c7d06a4a442 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Jul 15 14:06:04.652026 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 270/543] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:04 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:05.318811 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-125ac983-beaf-4ec3-8d11-a468aa123dc4 req-23af54f2-336e-4293-85a7-f98927722b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:05.328305 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-125ac983-beaf-4ec3-8d11-a468aa123dc4 req-23af54f2-336e-4293-85a7-f98927722b1c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:05.328792 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-125ac983-beaf-4ec3-8d11-a468aa123dc4 req-23af54f2-336e-4293-85a7-f98927722b1c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:05.341702 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-125ac983-beaf-4ec3-8d11-a468aa123dc4 req-23af54f2-336e-4293-85a7-f98927722b1c service nova] Creating event network-changed:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:06:05.346633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-125ac983-beaf-4ec3-8d11-a468aa123dc4 req-23af54f2-336e-4293-85a7-f98927722b1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031808 Jul 15 14:06:05.347231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 274/544] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:05.556227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:05.556945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:05.563769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:05.564213 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:05.565041 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:05.565479 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:05.664202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:05.665254 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:05.671806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:05.672258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:05.673065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:05.673494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:05.704800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-66fa383a-dfc0-4a40-94b8-9c312e136008 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Jul 15 14:06:05.705389 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 275/545] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:05 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:06:05.705532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:05.713327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b0e3be5b-8d70-46b4-80a0-b30cdde35937 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.160871 Jul 15 14:06:05.713914 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 271/546] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:05 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:06.717345 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:06.718270 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:06.724425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:06.725125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:06.725680 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:06.726124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:06.730046 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:06.730650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:06.739518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:06.740227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:06.741404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:06.742189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:06.760919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-57932533-e975-4d5d-bcc5-56c24c37e7c8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048029 Jul 15 14:06:06.764707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 276/547] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:06 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:06.927814 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86c21e37e2a49e9bdd48e15b091ce09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8c864a31b402880c334c39fbe5a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:06.935826 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6e35a279-2cf7-4979-a207-f6803449fab4 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 200 len: 1520 microversion: 2.1 time: 0.209495 Jul 15 14:06:06.936435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 272/548] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:06 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:07.352517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-da68247b-6922-4927-9a76-4bf83eab1217 req-0aae95fa-fccb-47be-82a2-536710d10c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6bc8f0-81aa-45df-9fb1-4e581cf0913e", "name": "network-vif-deleted", "tag": "c7be0622-dca5-4205-98fa-99c86a79c041"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:07.362347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-da68247b-6922-4927-9a76-4bf83eab1217 req-0aae95fa-fccb-47be-82a2-536710d10c87 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.362703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-da68247b-6922-4927-9a76-4bf83eab1217 req-0aae95fa-fccb-47be-82a2-536710d10c87 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.374243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-da68247b-6922-4927-9a76-4bf83eab1217 req-0aae95fa-fccb-47be-82a2-536710d10c87 service nova] Creating event network-vif-deleted:c7be0622-dca5-4205-98fa-99c86a79c041 for instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e on hv-cinder-85000 Jul 15 14:06:07.379490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-da68247b-6922-4927-9a76-4bf83eab1217 req-0aae95fa-fccb-47be-82a2-536710d10c87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jul 15 14:06:07.380125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 277/549] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:07.772773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:07.773680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:07.781462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.781918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.782712 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.783137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.814640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ec6a0361-c51f-46c1-b7f0-964e6d657527 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045720 Jul 15 14:06:07.815494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 273/550] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:07 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:06:07.827134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:07.828297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:07.830410 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:07.835668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.836117 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.836911 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.837342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.916186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] HTTP exception thrown: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd is not attached to volume 46cf7590-0e2a-4a50-9094-102ea958f568 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Request method failure captured: Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments/46cf7590-0e2a-4a50-9094-102ea958f568 HTTP/1.1 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XO3PwZKmB2umnkaixgXiWqlSCXsbrgu_0EC2RARITl9NFox8fAH3d2i0MDNwPGRUOVyhq2W6uNtLMJ6Zq4scnKYBDBXa-pX6F8gvDQob2q8Ti1m-hi4D_AoWvbkXOzjH9TCki_O7wXzn4A1UKbM-QGTVb-wsTjWZtho_wi321y8ANQ Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 11bf10102c9244f99f64ad5b4177407a Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:06:07.918599 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11bf10102c9244f99f64ad5b4177407a"}]}] Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 11bf10102c9244f99f64ad5b4177407a Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestMinimumBasicScenario-1840507380-project Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: a84ea9c601c44d75a19dee660c4ca756 Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestMinimumBasicScenario-1840507380-project Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:06:07.920629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd is not attached to volume 46cf7590-0e2a-4a50-9094-102ea958f568 Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'server_id': '0e79925f-bce9-485b-8ecb-008b21cc14fd', 'id': '46cf7590-0e2a-4a50-9094-102ea958f568'} Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 46cf7590-0e2a-4a50-9094-102ea958f568. Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:06:07.921477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd is not attached to volume 46cf7590-0e2a-4a50-9094-102ea958f568 Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd is not attached to volume 46cf7590-0e2a-4a50-9094-102ea958f568 Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.922698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Returning 404 to user: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd is not attached to volume 46cf7590-0e2a-4a50-9094-102ea958f568 {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:06:07.923597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8ae098a1-fa08-45db-a8c2-de06a6aa31ec tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments/46cf7590-0e2a-4a50-9094-102ea958f568" status: 404 len: 154 microversion: 2.1 time: 0.098950 Jul 15 14:06:07.923597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 278/551] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:06:07 2022] DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd/os-volume_attachments/46cf7590-0e2a-4a50-9094-102ea958f568 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:06:07.953948 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:07.955089 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] [instance: 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:07.961855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.962528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.963351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:07.963988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:07.982433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] HTTP exception thrown: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Request method failure captured: Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e HTTP/1.1 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMfaDEyIKpd84FJ2rOQ-kI_5629Y6r4gp41GUtGZIm-geOXUyKUsKMXcoU7P57HGIo86Hm7353xEOOFS31dSeXFEF4MaY85UCw0yN8VosxzHvrWIAhA93C_ZofDLqqtyJh0DSi3L1UWXLrO76wmG5imMMJQi2bFxzV9q3fO2Wi7zEQ Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:06:07.984791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77c8c864a31b402880c334c39fbe5a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77c8c864a31b402880c334c39fbe5a34"}]}] Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 77c8c864a31b402880c334c39fbe5a34 Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336041931 Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: b86c21e37e2a49e9bdd48e15b091ce09 Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336041931-project Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. Jul 15 14:06:07.986787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '0c6bc8f0-81aa-45df-9fb1-4e581cf0913e'} Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:06:07.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. Jul 15 14:06:07.989345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:06:07.990880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] Returning 404 to user: Instance 0c6bc8f0-81aa-45df-9fb1-4e581cf0913e could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:06:07.990880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3c48daac-25b4-4cd9-b5d6-90d3c62dd303 tempest-ServerRescueNegativeTestJSON-336041931 tempest-ServerRescueNegativeTestJSON-336041931-project] 10.222.0.16 "GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e" status: 404 len: 111 microversion: 2.1 time: 0.036455 Jul 15 14:06:07.990880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 274/552] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:07 2022] GET /compute/v2.1/servers/0c6bc8f0-81aa-45df-9fb1-4e581cf0913e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:06:09.092784 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:09.093393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:09.100607 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:09.101065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:09.102123 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:09.102563 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:09.133807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:06:09.224746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cf84facf-f537-4152-a3ce-4350a0bdde46 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 204 len: 0 microversion: 2.1 time: 0.135796 Jul 15 14:06:09.225333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 279/553] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:06:09 2022] DELETE /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:06:09.235903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:09.237027 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:09.244457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:09.244908 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:09.245692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:09.246124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:09.476811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:09.485692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c1b7128b-5fb2-48be-bcba-3c29e0a93664 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1550 microversion: 2.1 time: 0.255655 Jul 15 14:06:09.486272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 275/554] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:09 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1550 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:10.503528 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:10.504326 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:10.511048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:10.511498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:10.512267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:10.512738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:10.693771 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:10.702679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c1d2f509-2268-49c7-aa73-6349b428bb0d tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1550 microversion: 2.1 time: 0.203319 Jul 15 14:06:10.703223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 280/555] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:10 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:11.719792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:11.721192 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:11.735915 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:11.736358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:11.749633 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:11.750098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:11.834957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-65509f83-4964-48eb-ad0f-6e6cd7a9ff4b req-fa080dff-4a58-410c-8c51-fd9f3864ab1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79925f-bce9-485b-8ecb-008b21cc14fd", "name": "network-vif-deleted", "tag": "01da8f8b-bf3b-4832-a1ec-c52703b5ed24"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:11.847248 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-65509f83-4964-48eb-ad0f-6e6cd7a9ff4b req-fa080dff-4a58-410c-8c51-fd9f3864ab1d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:11.848052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-65509f83-4964-48eb-ad0f-6e6cd7a9ff4b req-fa080dff-4a58-410c-8c51-fd9f3864ab1d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:11.857436 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84ea9c601c44d75a19dee660c4ca756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bf10102c9244f99f64ad5b4177407a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:11.865465 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-65509f83-4964-48eb-ad0f-6e6cd7a9ff4b req-fa080dff-4a58-410c-8c51-fd9f3864ab1d service nova] Creating event network-vif-deleted:01da8f8b-bf3b-4832-a1ec-c52703b5ed24 for instance 0e79925f-bce9-485b-8ecb-008b21cc14fd on hv-cinder-85000 Jul 15 14:06:11.871071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-65509f83-4964-48eb-ad0f-6e6cd7a9ff4b req-fa080dff-4a58-410c-8c51-fd9f3864ab1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041162 Jul 15 14:06:11.873113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 281/556] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:11.878136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d7a4c99e-6929-430d-8483-2d407bb9c069 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 200 len: 1508 microversion: 2.1 time: 0.162785 Jul 15 14:06:11.879307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 276/557] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:11 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:12.900835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:12.901905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] [instance: 0e79925f-bce9-485b-8ecb-008b21cc14fd] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:12.913312 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:12.914126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:12.915487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:12.916499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:12.920199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:12.937788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] HTTP exception thrown: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Request method failure captured: Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd HTTP/1.1 Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XO3PwZKmB2umnkaixgXiWqlSCXsbrgu_0EC2RARITl9NFox8fAH3d2i0MDNwPGRUOVyhq2W6uNtLMJ6Zq4scnKYBDBXa-pX6F8gvDQob2q8Ti1m-hi4D_AoWvbkXOzjH9TCki_O7wXzn4A1UKbM-QGTVb-wsTjWZtho_wi321y8ANQ Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 11bf10102c9244f99f64ad5b4177407a Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:06:12.939455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11bf10102c9244f99f64ad5b4177407a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11bf10102c9244f99f64ad5b4177407a"}]}] Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 11bf10102c9244f99f64ad5b4177407a Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1840507380 Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestMinimumBasicScenario-1840507380-project Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: a84ea9c601c44d75a19dee660c4ca756 Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestMinimumBasicScenario-1840507380-project Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. Jul 15 14:06:12.941280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '0e79925f-bce9-485b-8ecb-008b21cc14fd'} Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:06:12.942004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. Jul 15 14:06:12.943144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:06:12.944212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Returning 404 to user: Instance 0e79925f-bce9-485b-8ecb-008b21cc14fd could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:06:12.944212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-25e8d416-c983-40fd-896c-0791bfaf71f8 tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd" status: 404 len: 111 microversion: 2.1 time: 0.046252 Jul 15 14:06:12.944212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 282/558] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:12 2022] GET /compute/v2.1/servers/0e79925f-bce9-485b-8ecb-008b21cc14fd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:06:12.950308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-70930e7a-0cb1-4185-9c94-02d5d9036b8e tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] Calling method '.version_select at 0x7fa0c102f280>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:12.969389 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-70930e7a-0cb1-4185-9c94-02d5d9036b8e tempest-TestMinimumBasicScenario-1840507380 tempest-TestMinimumBasicScenario-1840507380-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-53331937" status: 202 len: 0 microversion: 2.1 time: 0.022954 Jul 15 14:06:12.969978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 277/559] 10.222.0.16 () {58 vars in 1265 bytes} [Fri Jul 15 14:06:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-53331937 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:06:32.536676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:32.823346 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:32.824144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:32.832692 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:32.833750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:32.835077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:32.835809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:32.865898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9731808e-0d59-496c-9960-4e2f4d0e5107 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/ips" status: 200 len: 152 microversion: 2.20 time: 0.334748 Jul 15 14:06:32.867333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 283/560] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jul 15 14:06:32 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/ips => generated 152 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:06:33.793255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:33.794797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:33.985957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:33.986462 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:33.992560 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:33.993014 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:33.993784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:33.994223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:34.020678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-152a8e9c-2be8-4876-98da-66f41319b713 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/ips" status: 200 len: 145 microversion: 2.1 time: 0.228837 Jul 15 14:06:34.021243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 278/561] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:06:33 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/ips => generated 145 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:06:34.833466 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:34.834192 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:34.842622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:34.843168 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:34.844018 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:34.844587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:34.871318 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lazy-loading 'flavor' on Instance uuid 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:06:35.186081 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-98ade25d-035e-4fd6-9bd2-f0b12810348c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/action" status: 202 len: 0 microversion: 2.20 time: 0.356365 Jul 15 14:06:35.191184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 284/562] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jul 15 14:06:34 2022] POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:06:35.196751 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:35.199219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:35.207083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:35.207528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:35.208289 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:35.208748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:35.357424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:35.365875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:35.367412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:35.368601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e0e8063d-32ee-4cb8-8b07-522293a06b4c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.176119 Jul 15 14:06:35.369164 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 279/563] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:35 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:35.389931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc8615e9-70c5-4114-ba80-f8a6c85e5d2a"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:35.390988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:35.397463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:35.397907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:35.398677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:35.399106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:35.639595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-32553c02-3299-4cb5-a29e-8218a4d62565 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254428 Jul 15 14:06:35.644275 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 285/564] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:06:35 2022] POST /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:36.387184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:36.388367 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:36.395690 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:36.396143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:36.396980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:36.397388 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:36.534106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:36.542370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:36.543884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:36.545164 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4fef313c-af4e-4a46-8b6e-89ab7ed37264 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.162037 Jul 15 14:06:36.545734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 280/565] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:36 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:37.563490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:37.564212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:37.570904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:37.571347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:37.572114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:37.572586 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:37.716867 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:37.724875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:37.726387 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:37.727510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c2be909a-dfee-4be0-b790-e6458dc8c4ae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.168375 Jul 15 14:06:37.728067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 286/566] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:37 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:38.747167 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:38.748425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:38.755078 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:38.755530 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:38.756299 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:38.756762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:38.893861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:38.902364 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:38.904379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:38.905567 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cf41a78c-2e58-4dc8-af53-d91eb5c380da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.163249 Jul 15 14:06:38.906121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 281/567] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:38 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:39.924514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:39.925122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:39.932156 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:39.932637 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:39.933411 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:39.933887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:40.096273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:40.111624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:40.114386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:40.116241 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fba05a60-0a44-486d-854f-af88d67f95da tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.195576 Jul 15 14:06:40.117160 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 287/568] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:39 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:41.145829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:41.147281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:41.156013 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:41.156931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:41.157859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:41.159246 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:41.368622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:41.385544 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:41.389555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:41.391941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-df2f822e-8f7a-4927-b22c-39c06d5e9ab9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.249643 Jul 15 14:06:41.393637 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 282/569] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:41 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:42.128281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:42.130032 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:42.136955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.137422 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.139012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.139514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.171481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3adb2afa-05bd-487c-9309-20cf9aa250be tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Jul 15 14:06:42.172093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 288/570] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:42 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:42.198485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:42.200312 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:42.211680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.212375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.214069 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.215213 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.252705 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-222f54a4-3851-46f1-ba9b-12da01feaa24 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a" status: 200 len: 194 microversion: 2.1 time: 0.070532 Jul 15 14:06:42.253316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 283/571] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jul 15 14:06:42 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:42.417567 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:42.419001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:42.434284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.435429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.437204 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:42.438252 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:42.637794 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:42.646492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:42.648064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:42.649284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-76121fa0-e4b5-4b7f-bc76-442bf9ae067b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.239643 Jul 15 14:06:42.649843 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 289/572] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:42 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:43.672866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:43.673884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:43.679874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb7e1d9-450e-4b96-924e-31e83b0fa84b"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:43.682059 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:43.685451 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:43.686500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:43.687997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:43.689030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:43.699635 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:43.700366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:43.701692 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:43.702431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:43.902930 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:43.920264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:43.923190 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:43.925172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e82a4227-e74d-4f66-b74e-c4b69801b81d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.258505 Jul 15 14:06:43.926185 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 284/573] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:43 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:44.090062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b46bcead-ac26-48f7-8077-de3ba86f5050 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "POST /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417095 Jul 15 14:06:44.092428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 290/574] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:06:43 2022] POST /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:44.945637 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:44.946233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:44.954058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:44.954514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:44.955307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:44.955748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:45.105255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:45.115685 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:45.117236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:45.118400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f1774b17-b435-43cb-aeb1-754a11d4ae4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.177050 Jul 15 14:06:45.118959 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 285/575] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:44 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:45.768919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1406324034", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:45.819724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] validate_networks() for None {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:06:46.099688 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:06:46.100146 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:06:46.100693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:06:46.101182 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:06:46.101604 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:06:46.112075 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:46.112574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:46.113387 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:46.113829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:46.131970 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Getting quotas for project a63341c013394ac29ff8405711b0d6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:06:46.136372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Getting quotas for user a47c19f7d90b4b9a83e5ddf8627acf2f and project a63341c013394ac29ff8405711b0d6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:06:46.136571 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:46.137155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:46.148565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:46.149175 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:46.150317 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:46.150982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:46.158159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:06:46.161091 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:06:46.207532 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1d27c7db-b95e-41dc-af5e-6e1b46572c70 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.443304 Jul 15 14:06:46.208536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 291/576] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:06:46.218778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8aaad814-1bd0-4bd8-a352-2a19ca7151f6 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:46.219567 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8aaad814-1bd0-4bd8-a352-2a19ca7151f6 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:46.302271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8aaad814-1bd0-4bd8-a352-2a19ca7151f6 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:46.313092 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8aaad814-1bd0-4bd8-a352-2a19ca7151f6 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1215 microversion: 2.1 time: 0.097450 Jul 15 14:06:46.314031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 292/577] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:46 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:46.338932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:46.349366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:46.351000 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:46.352138 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b21b65fa-83cd-4879-b512-ada905827895 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.219569 Jul 15 14:06:46.352746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 286/578] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:46 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:47.330940 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:47.331548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:47.347082 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:47.347548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:47.348871 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:47.348871 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:47.381656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:47.382275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:47.391883 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:47.392460 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:47.393325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:47.393841 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:47.425837 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:47.435456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8935f465-5608-44d4-aa88-f3d688f3889a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1275 microversion: 2.1 time: 0.107666 Jul 15 14:06:47.436895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 293/579] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:47 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:47.570316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:47.583847 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:47.585141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:47.587404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-79d79e06-4931-447f-8895-a18ae2a56d45 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.217868 Jul 15 14:06:47.588454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 287/580] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:47 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:48.454494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:48.455205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:48.461746 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:48.462291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:48.463116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:48.463619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:48.616744 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:48.617361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:48.624818 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:48.625383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:48.626061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:48.626503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:48.627691 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:48.635933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-673f9a5a-0d05-4c7b-92a1-f76167fb09d1 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.185578 Jul 15 14:06:48.640239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 294/581] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:48 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:48.783874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:48.793232 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:48.795020 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:48.796629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e2d9d0af-faf2-4220-8bc6-42e42e0de48c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.183829 Jul 15 14:06:48.797694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 288/582] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:48 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:49.510803 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-0bde194b-b2a9-4832-840e-c3e1b7cdc026 req-7b2a9428-2564-4fb9-952d-eae9b3cab9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd1163-1126-4b7b-857d-fe5f0aea026f", "tag": "cd6f968c-c4a1-45fd-b278-a84fc559395e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:49.519970 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0bde194b-b2a9-4832-840e-c3e1b7cdc026 req-7b2a9428-2564-4fb9-952d-eae9b3cab9ee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:49.520433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0bde194b-b2a9-4832-840e-c3e1b7cdc026 req-7b2a9428-2564-4fb9-952d-eae9b3cab9ee service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:49.533243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-0bde194b-b2a9-4832-840e-c3e1b7cdc026 req-7b2a9428-2564-4fb9-952d-eae9b3cab9ee service nova] Creating event network-changed:cd6f968c-c4a1-45fd-b278-a84fc559395e for instance 07cd1163-1126-4b7b-857d-fe5f0aea026f on hv-cinder-85000 Jul 15 14:06:49.538845 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-0bde194b-b2a9-4832-840e-c3e1b7cdc026 req-7b2a9428-2564-4fb9-952d-eae9b3cab9ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193914 Jul 15 14:06:49.539625 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 295/583] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:06:49.657132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:49.657839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:49.664370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:49.664880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:49.665645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:49.666089 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:49.796707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:49.804214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-dc872d0b-f26b-44d6-bcbb-9c1024839a6f tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.151669 Jul 15 14:06:49.804809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 289/584] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:49 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:49.819336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:49.820039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:49.826870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:49.827322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:49.828106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:49.828593 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:49.965024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:49.973913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:49.975418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:49.976604 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e25e5d99-1439-4e11-94a0-736396d6977d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.161549 Jul 15 14:06:49.977189 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 296/585] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:49 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:50.821338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:50.821944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:50.828757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:50.829202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:50.829979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:50.830417 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:50.963315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:50.971368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3b6459b4-9be7-4f18-b1c8-b10f145a0bcc tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.153863 Jul 15 14:06:50.971935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 290/586] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:50 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:50.995045 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:50.995816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:51.002326 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:51.002780 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:51.003559 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:51.004033 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:51.019884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:51.150790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:51.161613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:51.163159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:51.164355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-848e4e1d-de22-435e-8794-6149c9b71952 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.173209 Jul 15 14:06:51.164945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 297/587] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:50 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:51.987993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:51.988636 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:51.995566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:51.996312 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:51.997899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:51.998337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.146058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:52.154124 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-db325e6c-01c9-4a07-aa03-7a15d528ae58 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.170298 Jul 15 14:06:52.155224 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 291/588] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:51 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:52.183980 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:52.186567 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:52.196929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.197564 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.198341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.198783 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.335198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:52.344344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:52.345877 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:52.347024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1b1f9dfb-54f9-44eb-8fdc-d7d3c6070b04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1744 microversion: 2.20 time: 0.168126 Jul 15 14:06:52.347579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 298/589] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:52 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:52.751768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:52.752898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:52.758830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.759271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.760237 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.760694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.797757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ee8f741e-5385-4a69-87c1-ce93752c71b4 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049580 Jul 15 14:06:52.798755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 292/590] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:52 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:52.944831 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:52.945681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:52.952695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.953171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.954127 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:52.954568 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:52.987693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3b8257d1-d4e8-44f6-8474-31f4796e1721 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a" status: 200 len: 194 microversion: 2.1 time: 0.046977 Jul 15 14:06:52.988789 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 299/591] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jul 15 14:06:52 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:52.999075 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:52.999654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:53.006525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.007075 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.008016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.008642 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.091520 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lazy-loading 'services' on Instance uuid 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:06:53.162564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b088ed54-4b9e-43f7-9af9-cd3280b586b9 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a" status: 202 len: 0 microversion: 2.1 time: 0.168238 Jul 15 14:06:53.163160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 293/592] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:06:52 2022] DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/cc8615e9-70c5-4114-ba80-f8a6c85e5d2a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:06:53.171168 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:53.172334 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:53.179491 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.180203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.181038 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.181632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.319801 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:53.327222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b51111af-6941-47db-a22e-1b3c508861f5 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.160062 Jul 15 14:06:53.327779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 300/593] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:53 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:53.366536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:53.367236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:53.373635 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.374086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.374851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:53.375288 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:53.379673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:53.506930 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:53.515957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:53.517499 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:53.518640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-260efa04-0dba-4c84-b601-979b16977c0c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1744 microversion: 2.20 time: 0.156347 Jul 15 14:06:53.519194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 294/594] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:53 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:54.214589 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-262e0c64-c97e-4a88-81c8-50d5b4549d63 req-03ac3d36-8714-47f5-a2c7-30d541f34eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cd1163-1126-4b7b-857d-fe5f0aea026f", "name": "network-vif-plugged", "status": "completed", "tag": "cd6f968c-c4a1-45fd-b278-a84fc559395e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:54.227679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-262e0c64-c97e-4a88-81c8-50d5b4549d63 req-03ac3d36-8714-47f5-a2c7-30d541f34eb8 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:54.228536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-262e0c64-c97e-4a88-81c8-50d5b4549d63 req-03ac3d36-8714-47f5-a2c7-30d541f34eb8 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:54.243799 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-262e0c64-c97e-4a88-81c8-50d5b4549d63 req-03ac3d36-8714-47f5-a2c7-30d541f34eb8 service nova] Creating event network-vif-plugged:cd6f968c-c4a1-45fd-b278-a84fc559395e for instance 07cd1163-1126-4b7b-857d-fe5f0aea026f on hv-cinder-85000 Jul 15 14:06:54.249009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-262e0c64-c97e-4a88-81c8-50d5b4549d63 req-03ac3d36-8714-47f5-a2c7-30d541f34eb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105346 Jul 15 14:06:54.250391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 301/595] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:54.346086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:54.346934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:54.357355 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:54.358386 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:54.359737 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:54.360825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:54.538468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:54.539358 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:54.547279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:54.547988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:54.548965 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:54.549687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:54.566599 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:54.576006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2cf68e8d-a359-421a-a51b-9ca991bebc4b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.236218 Jul 15 14:06:54.577317 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 295/596] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:54 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:54.700729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:54.709498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:54.711015 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:54.712203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c7540756-9801-416f-b49c-1ab8bd4c885f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.178504 Jul 15 14:06:54.713051 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 302/597] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:54 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:55.394776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:55.395409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:55.402443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.403025 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.404088 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.404621 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.437506 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-734981bd-4e67-494c-81e3-b4d0e36f6752 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/acb7e1d9-450e-4b96-924e-31e83b0fa84b" status: 200 len: 194 microversion: 2.1 time: 0.047283 Jul 15 14:06:55.438226 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 296/598] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jul 15 14:06:55 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/acb7e1d9-450e-4b96-924e-31e83b0fa84b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:06:55.448714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:55.449201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:55.456219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.457116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.459214 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.461198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.561219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lazy-loading 'services' on Instance uuid 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:06:55.594104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:55.595075 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:55.606956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.607404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.608180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.608647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.676351 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-59de8e3f-dd6a-43a7-b021-31cc0e003932 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/acb7e1d9-450e-4b96-924e-31e83b0fa84b" status: 202 len: 0 microversion: 2.1 time: 0.231209 Jul 15 14:06:55.677892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 303/599] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:06:55 2022] DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments/acb7e1d9-450e-4b96-924e-31e83b0fa84b => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:06:55.734974 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:55.735986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:55.744268 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.745285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.746828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:55.748088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:55.846338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:55.855073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d7f62a4d-24df-4fb2-9215-0fed07d8390d tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1315 microversion: 2.1 time: 0.264893 Jul 15 14:06:55.856239 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 297/600] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:55 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:55.937459 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:55.946844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:55.948341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:55.949558 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d7a608db-4e6a-4d9d-92ba-9bd21e094041 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.220573 Jul 15 14:06:55.950125 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 304/601] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:55 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:56.266357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-d158873c-2bb0-47a8-a758-2dda222c5c29 req-9755bb87-cc15-4e1a-8086-24b79a573d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "name": "network-vif-plugged", "status": "completed", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:06:56.287105 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-d158873c-2bb0-47a8-a758-2dda222c5c29 req-9755bb87-cc15-4e1a-8086-24b79a573d19 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:56.287622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-d158873c-2bb0-47a8-a758-2dda222c5c29 req-9755bb87-cc15-4e1a-8086-24b79a573d19 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:56.302781 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-d158873c-2bb0-47a8-a758-2dda222c5c29 req-9755bb87-cc15-4e1a-8086-24b79a573d19 service nova] Creating event network-vif-plugged:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:06:56.308218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-d158873c-2bb0-47a8-a758-2dda222c5c29 req-9755bb87-cc15-4e1a-8086-24b79a573d19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045940 Jul 15 14:06:56.309107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 298/602] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:06:56.885712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:56.887269 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:56.899146 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:56.900359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=8 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:06:56.911802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:56.912416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:56.913346 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:56.913833 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:56.970349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:56.972864 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:56.988946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:56.989848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:56.991535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:56.993020 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:57.194696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:57.203317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b9e64d50-550b-4b69-ab32-ba502cebed75 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1465 microversion: 2.1 time: 0.325380 Jul 15 14:06:57.204251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 305/603] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:56 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:57.246809 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:57.248090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:57.255403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:57.256184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:57.257140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:57.257813 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:57.274686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:57.286981 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:06:57.290842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:57.292485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:57.293792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-155b0cec-b370-4184-bf6f-11e972797024 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.330288 Jul 15 14:06:57.305198 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 299/604] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:56 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:06:57.386678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-616de98c-722f-42f3-9258-5301ae404303 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 204 len: 0 microversion: 2.1 time: 0.143160 Jul 15 14:06:57.387587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 306/605] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:06:57 2022] DELETE /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:06:57.398376 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:57.399702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:57.408653 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:57.409389 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:57.410354 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:57.410804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:57.564004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:57.572470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-227f7695-37c3-4d8a-a4a8-458d49f2891a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1471 microversion: 2.1 time: 0.180351 Jul 15 14:06:57.573281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 300/606] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:57 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:58.024312 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.026674 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.040031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.040997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.042649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.043526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.084465 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9f186902-c202-4dbf-ba22-7364451c872c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069830 Jul 15 14:06:58.085545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 307/607] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:58 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:06:58.214556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.217095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.225455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.225784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.226735 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.227196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.264843 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9e93a6c0-d9fd-4741-8ee8-44701a2a8a16 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054470 Jul 15 14:06:58.265829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 301/608] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:06:58 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:06:58.313502 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.314074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.322709 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.323174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.323979 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.324454 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.345865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.345865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.353892 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.354344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.355270 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.355722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.391633 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:06:58.494009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:58.503822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a2063ab1-12cf-4c24-ab22-bf773aa33853 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 204 len: 0 microversion: 2.1 time: 0.162900 Jul 15 14:06:58.504747 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 302/609] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:06:58 2022] DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 14:06:58.505745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:58.507516 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:58.509025 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8bb809cb-7dc7-4319-8138-56d12b4862c4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.200203 Jul 15 14:06:58.510403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 308/610] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:58 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:58.514098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.514812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.522511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.522511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.526686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.526686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.593126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:58.593763 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:58.601644 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.602505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.603481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:58.604097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:58.766441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:58.784256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-37131434-5023-4ff1-9760-5a2b54347489 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1672 microversion: 2.1 time: 0.274505 Jul 15 14:06:58.789377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 303/611] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:58 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1672 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:06:58.827475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:58.845880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-69deba15-b9b3-44c2-b51f-d31e3f16174a tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1471 microversion: 2.1 time: 0.257901 Jul 15 14:06:58.846725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 309/612] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:58 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:06:59.528626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:59.529427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:59.538987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.539448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:59.540464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.540913 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:59.732905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:59.752874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:59.757264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:06:59.758578 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1ae6bded-6e45-478d-a917-1c4873aa77c3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.234225 Jul 15 14:06:59.759368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 304/613] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:06:59 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:06:59.816844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:59.818458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:59.826105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.826557 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:59.827337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.827779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:59.875589 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:06:59.878043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:06:59.890566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.893863 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:06:59.904324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:06:59.905132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:00.078559 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:00.087913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f70a17e6-f1da-4f21-91bb-e97ffee81c3e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1672 microversion: 2.1 time: 0.275789 Jul 15 14:07:00.089257 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 310/614] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:59 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:00.133487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:00.146140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ca2e384a-eeed-4ca5-8cfb-0a4f8c743875 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1471 microversion: 2.1 time: 0.282774 Jul 15 14:07:00.147272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 305/615] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:06:59 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:00.782604 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:00.783222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:00.789611 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:00.790148 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:00.790928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:00.791365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:01.048893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:01.062129 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:01.065432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:01.068179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4cca3fe5-ed65-4b65-9e65-60f7b53f9887 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.293884 Jul 15 14:07:01.073842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 311/616] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:00 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:01.121786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:01.123316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:01.137600 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:01.138262 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:01.139484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:01.140171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:01.172051 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:01.174584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:01.193078 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:01.194435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:01.196552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:01.197829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:01.255259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:01.613922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:01.656418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a27e44ce-cc77-4dc7-bcb4-bd8acf574c78 tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1471 microversion: 2.1 time: 0.488320 Jul 15 14:07:01.657815 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 312/617] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:01 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:01.689378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:01.699431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-01ddf568-1089-4b94-9657-ec73d464fce8 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1672 microversion: 2.1 time: 0.584153 Jul 15 14:07:01.711748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 306/618] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:01 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1672 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:02.049481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-9d879f45-a070-4e2a-a749-87841c615c8a req-c4a9cf24-4e13-41ba-8290-a38f1c948060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cd1163-1126-4b7b-857d-fe5f0aea026f", "name": "network-vif-deleted", "tag": "cd6f968c-c4a1-45fd-b278-a84fc559395e"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:02.069366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-9d879f45-a070-4e2a-a749-87841c615c8a req-c4a9cf24-4e13-41ba-8290-a38f1c948060 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.070171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-9d879f45-a070-4e2a-a749-87841c615c8a req-c4a9cf24-4e13-41ba-8290-a38f1c948060 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.087968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:02.089039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:02.092915 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-9d879f45-a070-4e2a-a749-87841c615c8a req-c4a9cf24-4e13-41ba-8290-a38f1c948060 service nova] Creating event network-vif-deleted:cd6f968c-c4a1-45fd-b278-a84fc559395e for instance 07cd1163-1126-4b7b-857d-fe5f0aea026f on hv-cinder-85000 Jul 15 14:07:02.102623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-9d879f45-a070-4e2a-a749-87841c615c8a req-c4a9cf24-4e13-41ba-8290-a38f1c948060 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059741 Jul 15 14:07:02.102875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.105337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.107621 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.107869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 313/619] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:07:02.111545 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.300111 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:02.308433 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:02.310851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:02.312284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7db2a7ef-1cf4-46c0-83e2-6846b20e7ccf tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.228939 Jul 15 14:07:02.313094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 307/620] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:02 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:07:02.692178 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:02.693869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:02.703363 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:02.706842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.707971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.709129 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.709756 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.722562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:02.724104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:02.737385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.738167 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.748119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.748941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.806205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:02.808543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:02.809598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lazy-loading 'fault' on Instance uuid 07cd1163-1126-4b7b-857d-fe5f0aea026f {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:07:02.906371 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:02.916587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9a819309-575f-404f-951d-314bd131ef7f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1605 microversion: 2.1 time: 0.200709 Jul 15 14:07:02.917342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 308/621] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:02 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1605 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:02.924686 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47c19f7d90b4b9a83e5ddf8627acf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63341c013394ac29ff8405711b0d6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:02.943092 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-23f705b4-a5d1-4020-81d8-8ba58b65b77b tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 200 len: 1305 microversion: 2.1 time: 0.258934 Jul 15 14:07:02.944075 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 314/622] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:02 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 1305 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:03.331566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:03.332152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:03.347090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.347722 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:03.348552 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.348997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:03.531860 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:03.539885 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:03.545416 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:03.547249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:03.548895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d4c49495-e395-468a-bb29-e90548273ee7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.221201 Jul 15 14:07:03.561066 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 309/623] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:03 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:03.935962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:03.937333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:03.944004 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.944907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:03.945926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.946582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:03.969395 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:03.971031 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] [instance: 07cd1163-1126-4b7b-857d-fe5f0aea026f] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:03.979480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:03.986749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.987604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:03.988674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:03.989335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:04.008296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] HTTP exception thrown: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. Jul 15 14:07:04.009934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:04.010491 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:04.010963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lazy-loading 'fault' on Instance uuid 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Request method failure captured: Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f HTTP/1.1 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XR0lv1tVne9Sq89gj0INPy-NbrkNFmbXg_2TxIkgtkT0odUdYLur5zv_5O8gE0j-vhUWYn6RCggswMpQMu-pXihRUH-ToXm6doZQz6OCeMAw6L2b4cXxtn1__COMJfuDMHlcqvTPkp_-ywBDGPfeMHOV-weIMpGZa2lGsla3yDk0n4 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: a63341c013394ac29ff8405711b0d6d9 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesNegativeTest-1625312736 Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:07:04.011107 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a63341c013394ac29ff8405711b0d6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63341c013394ac29ff8405711b0d6d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63341c013394ac29ff8405711b0d6d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a63341c013394ac29ff8405711b0d6d9"}]}] Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesNegativeTest-1625312736 Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: a63341c013394ac29ff8405711b0d6d9 Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesNegativeTest-1625312736 Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesNegativeTest-1625312736-project Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: a47c19f7d90b4b9a83e5ddf8627acf2f Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesNegativeTest-1625312736-project Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. Jul 15 14:07:04.032811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '07cd1163-1126-4b7b-857d-fe5f0aea026f'} Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:04.034474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. Jul 15 14:07:04.035935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:04.038692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] Returning 404 to user: Instance 07cd1163-1126-4b7b-857d-fe5f0aea026f could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:04.038692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3fd5a5c9-8126-477d-8a57-4f9057a7a39c tempest-VolumesNegativeTest-1625312736 tempest-VolumesNegativeTest-1625312736-project] 10.222.0.16 "GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f" status: 404 len: 111 microversion: 2.1 time: 0.053705 Jul 15 14:07:04.038692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 310/624] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:03 2022] GET /compute/v2.1/servers/07cd1163-1126-4b7b-857d-fe5f0aea026f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:04.139662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d4c389c4da4d2188e8a32e5ed1be7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8778d5da3de4c4dbae5d24842b359bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:04.156248 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-28f9ce1f-43fc-4c92-af66-480e7053b01c tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 200 len: 1327 microversion: 2.1 time: 0.223396 Jul 15 14:07:04.159618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-558eeb28-019c-40b6-b5c4-ef4af8304b0b req-bf3d6605-1e46-4115-8964-fc1fb70978a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fa1bf5-3ff3-468a-bc34-6bb3a90494a4", "name": "network-vif-deleted", "tag": "815bc904-57dc-4545-9f06-3e6e84c15272"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:04.167468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 315/625] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:03 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 1327 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:04.183366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-558eeb28-019c-40b6-b5c4-ef4af8304b0b req-bf3d6605-1e46-4115-8964-fc1fb70978a4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:04.184001 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-558eeb28-019c-40b6-b5c4-ef4af8304b0b req-bf3d6605-1e46-4115-8964-fc1fb70978a4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:04.215988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-558eeb28-019c-40b6-b5c4-ef4af8304b0b req-bf3d6605-1e46-4115-8964-fc1fb70978a4 service nova] Creating event network-vif-deleted:815bc904-57dc-4545-9f06-3e6e84c15272 for instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 on hv-cinder-85000 Jul 15 14:07:04.223675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-558eeb28-019c-40b6-b5c4-ef4af8304b0b req-bf3d6605-1e46-4115-8964-fc1fb70978a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073063 Jul 15 14:07:04.224813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 311/626] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:04.568784 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:04.569397 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:04.580856 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:04.581280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:04.582093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:04.582533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:04.786588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:04.802224 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:04.804774 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:04.806200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e260be4f-7763-4231-b7fa-734a28fec269 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1739 microversion: 2.20 time: 0.241537 Jul 15 14:07:04.817295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 316/627] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:04 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:05.174686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:05.175427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:05.181736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:05.182191 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:05.182964 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:05.183398 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:05.199189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 HTTP/1.1 Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:07:05.201441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:05.203387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '95fa1bf5-3ff3-468a-bc34-6bb3a90494a4'} Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:05.204351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:05.206189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:05.208880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:05.208880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-547b4b35-d84e-4d86-aadc-3bba7b3efff0 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 404 len: 111 microversion: 2.1 time: 0.032918 Jul 15 14:07:05.208880 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 312/628] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:05 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:05.212173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5cc26f8b-9729-4b6f-b406-fee33af7fc13 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '.version_select at 0x7fa0c10e9d30>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:05.230353 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5cc26f8b-9729-4b6f-b406-fee33af7fc13 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850153713" status: 202 len: 0 microversion: 2.1 time: 0.021917 Jul 15 14:07:05.230893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 317/629] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jul 15 14:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850153713 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:07:05.824955 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:05.826245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:05.833910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:05.834435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:05.835308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:05.835821 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:05.984673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:05.993763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:05.995257 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:05.996451 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-93b50ee7-18c8-4d58-bb15-356215e1860d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1721 microversion: 2.20 time: 0.175696 Jul 15 14:07:05.997519 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 313/630] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:05 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:07.022553 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:07.023203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:07.030656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:07.031110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:07.031893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:07.032336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:07.174779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:07.182770 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:07.184291 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:07.185517 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4bd6c0d6-c148-47ba-9f87-4a3261f05ae3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1721 microversion: 2.20 time: 0.167551 Jul 15 14:07:07.186071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 318/631] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:07 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:08.133757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-05b22ffe-1eb0-4a65-9824-f4964ff1cc1f req-560f2496-c752-4db1-8110-b3f4842cfe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "name": "network-vif-unplugged", "status": "completed", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:08.147417 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-05b22ffe-1eb0-4a65-9824-f4964ff1cc1f req-560f2496-c752-4db1-8110-b3f4842cfe77 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.147417 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-05b22ffe-1eb0-4a65-9824-f4964ff1cc1f req-560f2496-c752-4db1-8110-b3f4842cfe77 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.155214 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-05b22ffe-1eb0-4a65-9824-f4964ff1cc1f req-560f2496-c752-4db1-8110-b3f4842cfe77 service nova] Creating event network-vif-unplugged:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:07:08.161045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-05b22ffe-1eb0-4a65-9824-f4964ff1cc1f req-560f2496-c752-4db1-8110-b3f4842cfe77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030103 Jul 15 14:07:08.161045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 314/632] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:08.211817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:08.212513 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:08.220352 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.221313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.222245 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.223106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.363852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:08.374888 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:08.376485 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:08.377742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c198a6a7-f561-471e-ab39-a5136b308c87 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1721 microversion: 2.20 time: 0.177551 Jul 15 14:07:08.388532 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 319/633] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:08 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:08.810831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:08.811402 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:08.817845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.818282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.819045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.819475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.833307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 HTTP/1.1 Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:07:08.834982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.836710 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '95fa1bf5-3ff3-468a-bc34-6bb3a90494a4'} Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:08.837498 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.838686 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.840625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:08.840625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-70409b15-d651-4828-b5f0-f948371b5a19 tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 404 len: 111 microversion: 2.1 time: 0.029714 Jul 15 14:07:08.840625 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 315/634] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:07:08 2022] DELETE /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:08.846704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:08.847315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:08.853520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.853972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.854776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:08.855212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:08.874259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 HTTP/1.1 Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:07:08.875899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.877505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '95fa1bf5-3ff3-468a-bc34-6bb3a90494a4'} Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:08.878395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. Jul 15 14:07:08.879858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:08.881735 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:08.881735 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-56c883ce-c1ed-4669-9ec5-ce82bddcbb3f tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4" status: 404 len: 111 microversion: 2.1 time: 0.035394 Jul 15 14:07:08.881735 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 320/635] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:08 2022] GET /compute/v2.1/servers/95fa1bf5-3ff3-468a-bc34-6bb3a90494a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:09.397543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:09.398155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:09.405070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:09.405522 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:09.406296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:09.406738 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:09.545837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:09.554037 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:09.555627 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:09.557455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1353d473-8178-4ea3-bb0a-3488fdab1a04 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1664 microversion: 2.20 time: 0.163458 Jul 15 14:07:09.558188 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 316/636] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:09 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:09.576920 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a1a1023-917b-4925-8ef4-7dd9d0738b41"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:09.578251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:09.584826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:09.585366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:09.586209 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:09.586714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:09.905833 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cc50fa86-89de-4698-8e61-82db2ad0bd76 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332145 Jul 15 14:07:09.906826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 321/637] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jul 15 14:07:09 2022] POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 14:07:10.047567 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:10.050537 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:10.059273 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.059829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.067797 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:10.068439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:10.073936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.074810 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.080317 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.080905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.083715 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.084619 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.100838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 HTTP/1.1 Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:07:10.102428 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.103835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '4a543a41-bbbc-4c3a-833a-903faa97dde7'} Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:10.104757 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.105987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.108624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:10.109908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7200f10d-fdb0-4a7b-ba67-37cf3e17588e tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 404 len: 111 microversion: 2.1 time: 0.047041 Jul 15 14:07:10.110661 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 322/638] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:07:10 2022] DELETE /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:10.125193 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:10.125816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] [instance: 4a543a41-bbbc-4c3a-833a-903faa97dde7] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:10.132089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.132584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.133359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.133929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.149855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] HTTP exception thrown: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Request method failure captured: Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 HTTP/1.1 Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMmvHp9hWAbWjSoWDacn3CXu1isqv6REOYzx1-irmIlUeGcFtlkGOfsd6hp74VvlLC778-TslFK_ikiIHndCTxGzuQKlOrDzNW_9LvXzDzqWzWqU9T3YbTXuF45yhGgl4BGYZhuSp8RphFd-aMuwjwLtxYFIykHKQxt3Ilffw8zq5Y Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:07:10.151404 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8778d5da3de4c4dbae5d24842b359bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8778d5da3de4c4dbae5d24842b359bc"}]}] Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c8778d5da3de4c4dbae5d24842b359bc Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-198939433 Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 96d4c389c4da4d2188e8a32e5ed1be7d Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeTestJSON-198939433-project Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.153079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '4a543a41-bbbc-4c3a-833a-903faa97dde7'} Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:07:10.153961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. Jul 15 14:07:10.155983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:07:10.157417 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] Returning 404 to user: Instance 4a543a41-bbbc-4c3a-833a-903faa97dde7 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:07:10.157417 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6354f739-9fb2-46e0-ab22-c10ea7180aef tempest-AttachVolumeTestJSON-198939433 tempest-AttachVolumeTestJSON-198939433-project] 10.222.0.16 "GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7" status: 404 len: 111 microversion: 2.1 time: 0.036595 Jul 15 14:07:10.157417 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 323/639] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:10 2022] GET /compute/v2.1/servers/4a543a41-bbbc-4c3a-833a-903faa97dde7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:07:10.459997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e593f7d6-691a-4cf0-bc6a-13c2266c1cc4 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments/3a1a1023-917b-4925-8ef4-7dd9d0738b41" status: 202 len: 0 microversion: 2.20 time: 0.419562 Jul 15 14:07:10.461096 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 317/640] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jul 15 14:07:10 2022] DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments/3a1a1023-917b-4925-8ef4-7dd9d0738b41 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:07:10.530411 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:10.530977 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:10.537276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.537726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.538499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.539001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.694373 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-58dc0fdf-abcc-4f27-80e4-df82d5e22d77 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/action" status: 202 len: 0 microversion: 2.20 time: 0.168365 Jul 15 14:07:10.698286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 324/641] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jul 15 14:07:10 2022] POST /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:07:10.704466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:10.705166 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:10.713104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.713596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.714707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:10.715215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:10.897114 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:10.905284 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:10.906879 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:10.908032 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1035ba5a-3465-4443-b517-259ad0edbac3 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1672 microversion: 2.20 time: 0.208670 Jul 15 14:07:10.908645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 318/642] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:10 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:11.927552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:11.928110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:11.936103 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:11.936586 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:11.937387 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:11.938659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:12.093260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:12.103467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:12.105595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:12.107061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5b762d27-c663-48ab-9c62-6acefa07b018 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.183760 Jul 15 14:07:12.107903 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 325/643] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:11 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:13.127973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:13.130071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:13.137565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:13.138149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:13.139624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:13.140324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:13.283651 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:13.292784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:13.295321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:13.297067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2b2efa98-cb7f-414b-99e1-b42b3d7043c9 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.173242 Jul 15 14:07:13.307460 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 319/644] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:13 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:14.316344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:14.317013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:14.324940 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:14.325456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:14.326676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:14.327115 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:14.469388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:14.483289 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:14.485116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:14.486261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1c83370f-2298-42e6-9eb2-9033e821adae tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.174802 Jul 15 14:07:14.486804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 326/645] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:14 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:15.505002 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:15.505626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:15.518345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:15.518808 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:15.531709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:15.532900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:15.771225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:15.782177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:15.783932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:15.785565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6cb1ded8-7b68-49a7-a8d5-6a5d96ac895b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.284671 Jul 15 14:07:15.786200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 320/646] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:15 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:16.806198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:16.812657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:16.819909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:16.820362 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:16.831301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:16.831878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:17.264552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:17.296240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:17.296240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:17.302422 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d3cf8e6c-b20b-46e7-a20f-2ec54da00f9c tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.500160 Jul 15 14:07:17.316358 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 327/647] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:16 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:18.330698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:18.332575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:18.343801 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:18.344677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:18.345857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:18.346559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:18.780586 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:18.809205 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:18.812184 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:18.813859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5d85fda4-0f65-4eb0-b418-9dcdbc22bfb7 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.490148 Jul 15 14:07:18.827921 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 321/648] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:18 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:19.834354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:19.835278 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:19.844181 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:19.848640 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:19.850773 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:19.852083 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:19.911935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:20.442431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:20.456276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:20.457876 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:20.465311 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-93a4a428-c215-4a35-8e09-1ef33a95924d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.628715 Jul 15 14:07:20.479255 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 328/649] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:19 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:21.485279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:21.485973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:21.503913 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:21.516222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:21.522092 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:21.524091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:22.456204 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:22.469986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:22.475990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:22.477397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-89b04f05-a9a0-4974-b799-a8f0f0c41417 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.997576 Jul 15 14:07:22.480478 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 322/650] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:21 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:23.499158 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:23.500587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:23.525542 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:23.537530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:23.541899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:23.547320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:24.127486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:24.139742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:24.141883 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:24.153052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fb98f7f3-84ce-4988-8f28-e057a32c9894 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.654236 Jul 15 14:07:24.160788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 329/651] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:23 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:24.504828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4a391522-67fe-4a1a-b6f5-b6dffce99860 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: .version_select at 0x7fa0c0ff2820>, body: {"keypair": {"name": "tempest-keypair-1202889508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc4+CeT4N1GC+tW7lNweKSOSPrzxQ6N0P0xkoQPsfHZT37GVuUWB4qKwShvuAELdS1BsXlpjPPXMVq/TI28mMSGFGY2QoI08XtrRj7z7ztuTj4rpyIX7jT4EBVgrYBV4Q=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:24.528276 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-4a391522-67fe-4a1a-b6f5-b6dffce99860 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:07:24.534617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-4a391522-67fe-4a1a-b6f5-b6dffce99860 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:07:24.578919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4a391522-67fe-4a1a-b6f5-b6dffce99860 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.309346 Jul 15 14:07:24.579893 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 323/652] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:07:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:25.178639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:25.180101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:25.205783 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:25.206596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:25.207904 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:25.209144 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:25.458695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:25.478478 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:25.480699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:25.483047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0849080e-850f-4203-9b32-dd92d502b67e tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.313427 Jul 15 14:07:25.499634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 330/653] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:25 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:07:26.505860 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:26.506514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:26.526344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:26.526869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:26.527598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:26.528222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:26.870668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:26.883546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:26.894231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:26.895739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-24085007-c6cb-4993-acb9-fb5de496fe11 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.393804 Jul 15 14:07:26.896889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 324/654] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:26 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:27.035941 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466604720", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98015688-617a-4c97-89d4-c0de9e353bb5"}], "security_groups": [{"name": "tempest-securitygroup--1525046194"}], "key_name": "tempest-keypair-1202889508", "user_data": "}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:27.164855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] validate_networks() for [('98015688-617a-4c97-89d4-c0de9e353bb5', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:07:27.917254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:27.917881 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:27.932946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:27.933323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:27.937398 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:27.939122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:27.983909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:07:27.984336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:07:27.985112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:07:27.985677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:07:27.986086 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:07:28.006354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:28.006810 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:28.007664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:28.011239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:28.071271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:07:28.078453 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:07:28.105168 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:07:28.108130 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:07:28.190617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-de2c9aae-4754-4779-a9a9-150e82131eff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.160021 Jul 15 14:07:28.195309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 331/655] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:07:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:07:28.206332 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-af0e469b-5dbf-452a-81aa-6c988f778966 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:28.207089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-af0e469b-5dbf-452a-81aa-6c988f778966 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:28.221271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:28.231140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:28.235533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:28.245215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-30f607de-2ccb-438f-b9ef-f95275585607 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.334240 Jul 15 14:07:28.246212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 325/656] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:27 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:28.317377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-af0e469b-5dbf-452a-81aa-6c988f778966 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:28.325060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-af0e469b-5dbf-452a-81aa-6c988f778966 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1241 microversion: 2.1 time: 0.122702 Jul 15 14:07:28.325783 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 332/657] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:28 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:29.267636 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:29.268668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:29.275833 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:29.277119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:29.278335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:29.278903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:29.343727 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:29.344337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:29.351369 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:29.351814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:29.352630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:29.353987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:29.465364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:29.484506 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-dd0bea9c-182d-420a-92f5-8cd7a5a57b30 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1293 microversion: 2.1 time: 0.138049 Jul 15 14:07:29.485586 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 333/658] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:29 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1293 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:29.554944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:29.565715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:29.567876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:29.569559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-87d98e24-efce-41bc-a891-48e1bec98926 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.307246 Jul 15 14:07:29.570310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 326/659] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:29 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:30.509662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:30.512926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:30.523298 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:30.525093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:30.526303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:30.527024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:30.604196 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:30.608897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:30.626546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:30.627602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:30.628790 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:30.629980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:30.642439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:30.652012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-77b9634e-20e5-4034-aafe-0e40395dfd52 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1299 microversion: 2.1 time: 0.149053 Jul 15 14:07:30.666571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 334/660] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:30 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:30.878304 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:30.890476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:30.898209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:30.903720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-dfede66b-839e-4599-94b0-1561c1d17845 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.317105 Jul 15 14:07:30.907566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 327/661] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:30 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:31.346488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-a3ffdcad-0d9a-4881-a194-7df01f65639a req-78b78e84-0c35-425a-bc66-d3920e457e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "name": "network-vif-plugged", "status": "completed", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:31.356577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-a3ffdcad-0d9a-4881-a194-7df01f65639a req-78b78e84-0c35-425a-bc66-d3920e457e3c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:31.357372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-a3ffdcad-0d9a-4881-a194-7df01f65639a req-78b78e84-0c35-425a-bc66-d3920e457e3c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:31.372364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-a3ffdcad-0d9a-4881-a194-7df01f65639a req-78b78e84-0c35-425a-bc66-d3920e457e3c service nova] Creating event network-vif-plugged:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:07:31.379023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-a3ffdcad-0d9a-4881-a194-7df01f65639a req-78b78e84-0c35-425a-bc66-d3920e457e3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045194 Jul 15 14:07:31.380074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 335/662] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:31.670674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:31.671524 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:31.684946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:31.686064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:31.686950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:31.687505 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:31.718755 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:31.924351 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:31.925446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:31.940009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:31.942043 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:31.945219 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:31.945778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:32.539290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:32.544507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:32.574996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:32.575359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f0f4cf1d-2eb3-4fdc-b4e5-f00d7057be0f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.901611 Jul 15 14:07:32.576342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 328/663] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:31 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:32.579481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:32.595364 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-dfc77c76-0bf6-49b4-a872-36c8787328f6 req-a3a6d27a-3b9c-48ff-9ccb-32860f7d7a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8b8d9e-553e-4193-aaf6-1f599d5282bc", "tag": "08923a84-8b04-41f6-8ada-897d5d2d5a5e"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:32.596231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fe3a6737-f0e0-4814-80ca-b22376f1f17d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.676652 Jul 15 14:07:32.597929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 336/664] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:31 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:32.617209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-dfc77c76-0bf6-49b4-a872-36c8787328f6 req-a3a6d27a-3b9c-48ff-9ccb-32860f7d7a6e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:32.617996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-dfc77c76-0bf6-49b4-a872-36c8787328f6 req-a3a6d27a-3b9c-48ff-9ccb-32860f7d7a6e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:32.660281 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-dfc77c76-0bf6-49b4-a872-36c8787328f6 req-a3a6d27a-3b9c-48ff-9ccb-32860f7d7a6e service nova] Creating event network-changed:08923a84-8b04-41f6-8ada-897d5d2d5a5e for instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc on hv-cinder-85000 Jul 15 14:07:32.683115 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-dfc77c76-0bf6-49b4-a872-36c8787328f6 req-a3a6d27a-3b9c-48ff-9ccb-32860f7d7a6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104849 Jul 15 14:07:32.684575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 329/665] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:33.592770 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:33.593483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:33.616875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:33.618495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:33.619199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:33.629630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:33.633391 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:33.635070 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:33.636047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:33.640083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:33.640583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:33.641393 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:33.641842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:34.001334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:34.019127 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:34.020820 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:34.031656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:34.031927 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-08d4dd7d-c21e-4843-89b8-6eef910aa2d2 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1730 microversion: 2.20 time: 0.417176 Jul 15 14:07:34.035374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 330/666] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:33 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1730 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:34.051947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5c6f5e55-14fb-4b1d-8fb9-28ffff530b3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.461737 Jul 15 14:07:34.060577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 337/667] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:33 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:35.053899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:35.054531 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:35.057717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:35.058778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:35.071747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:35.072375 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:35.072896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:35.073358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:35.074143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:35.074588 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:35.080885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:35.081335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:35.082319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:35.082959 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:35.435256 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:35.451354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:35.452533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:35.454251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:35.456511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7fedf8b2-750b-4ddf-8c70-75e0c5f17c20 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1717 microversion: 2.20 time: 0.407159 Jul 15 14:07:35.457889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 331/668] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:07:35 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1717 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:07:35.468276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-35325d35-092d-4fe6-b90a-5d863c6c7496 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.394093 Jul 15 14:07:35.468276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 338/669] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:35 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:36.194003 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1b16b1ee-8901-4836-b855-1a478ce66c29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Action: 'create', calling method: .version_select at 0x7fa0c0fa49d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1851351781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgAt/HX5dpYBUrNwwOPsXLw9HjalvLfWdBs4lXwKZhwcTFgWgbVr04+P2nHMI3UAvVIjf+1dyJltLfBfDLYsZaMNJbQLUzxBt755GzMpR5qNSTK/n5pkrWNAthm8FdkYg=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:36.208798 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-1b16b1ee-8901-4836-b855-1a478ce66c29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Getting quotas for project e608cc75a5ed4f05b462c84c29a31788. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:07:36.213199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-1b16b1ee-8901-4836-b855-1a478ce66c29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Getting quotas for user f72d7744f4c4493a8e2a5f87e9a89d5c and project e608cc75a5ed4f05b462c84c29a31788. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:07:36.237689 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1b16b1ee-8901-4836-b855-1a478ce66c29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.259255 Jul 15 14:07:36.243581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 332/670] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:07:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:36.479020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:36.479703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:36.487823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:36.488801 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:36.489848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:36.490617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:36.634250 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:36.643121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-764764bf-f2f4-45b8-aa53-c30a2d561c24 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.168613 Jul 15 14:07:36.643706 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 339/671] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:36 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:37.661830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:37.662439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:37.670255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:37.670706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:37.671564 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:37.671978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:37.844347 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:37.853019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7fe32b2f-f487-4b90-9906-ca8d1f71644e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.195580 Jul 15 14:07:37.853746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 333/672] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:37 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:38.874229 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:38.875494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:38.886324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:38.887071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=8 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:38.888937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:38.889386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:38.890539 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:38.891169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:39.074882 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:39.085760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-97be55ea-3842-4e8c-9041-cb828bddb008 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.218274 Jul 15 14:07:39.086490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 340/673] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:38 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:39.125547 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-16632d5b-3656-4d53-bb26-314f4fcb2a64 req-e40a0b21-7107-427c-9820-146c93df2684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8b8d9e-553e-4193-aaf6-1f599d5282bc", "name": "network-vif-plugged", "status": "completed", "tag": "08923a84-8b04-41f6-8ada-897d5d2d5a5e"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:39.140903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-16632d5b-3656-4d53-bb26-314f4fcb2a64 req-e40a0b21-7107-427c-9820-146c93df2684 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:39.143650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-16632d5b-3656-4d53-bb26-314f4fcb2a64 req-e40a0b21-7107-427c-9820-146c93df2684 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:39.157390 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-16632d5b-3656-4d53-bb26-314f4fcb2a64 req-e40a0b21-7107-427c-9820-146c93df2684 service nova] Creating event network-vif-plugged:08923a84-8b04-41f6-8ada-897d5d2d5a5e for instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc on hv-cinder-85000 Jul 15 14:07:39.172925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-16632d5b-3656-4d53-bb26-314f4fcb2a64 req-e40a0b21-7107-427c-9820-146c93df2684 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055091 Jul 15 14:07:39.174350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 334/674] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:40.102397 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:40.102994 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:40.110493 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:40.110933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:40.111740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:40.112237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:40.256374 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:40.264208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ff81ceff-2de5-4ef6-8eb0-ef117510345d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1367 microversion: 2.1 time: 0.165563 Jul 15 14:07:40.264826 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 341/675] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:40 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:41.282366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:41.283001 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:41.289458 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:41.289911 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:41.290700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:41.291171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:41.437404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:41.444996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-733d4607-852d-486f-8cd5-13d19bbd0039 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1557 microversion: 2.1 time: 0.167389 Jul 15 14:07:41.445650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 335/676] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:41 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:41.461925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:41.461925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:41.470042 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:41.470495 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:41.471282 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:41.471722 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:41.567456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7bd60f5c-7ea1-4569-a6d7-439a705f7aff tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110139 Jul 15 14:07:41.568064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 342/677] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:07:41 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:42.812463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-b013845b-e977-49c3-ac72-ccced34d5a1e req-9e8fe2fc-0f8f-4473-8b9e-00e023435428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8b8d9e-553e-4193-aaf6-1f599d5282bc", "tag": "08923a84-8b04-41f6-8ada-897d5d2d5a5e"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:42.821246 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b013845b-e977-49c3-ac72-ccced34d5a1e req-9e8fe2fc-0f8f-4473-8b9e-00e023435428 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:42.821776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-b013845b-e977-49c3-ac72-ccced34d5a1e req-9e8fe2fc-0f8f-4473-8b9e-00e023435428 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:42.833501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-b013845b-e977-49c3-ac72-ccced34d5a1e req-9e8fe2fc-0f8f-4473-8b9e-00e023435428 service nova] Creating event network-changed:08923a84-8b04-41f6-8ada-897d5d2d5a5e for instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc on hv-cinder-85000 Jul 15 14:07:42.838283 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-b013845b-e977-49c3-ac72-ccced34d5a1e req-9e8fe2fc-0f8f-4473-8b9e-00e023435428 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084794 Jul 15 14:07:42.839336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 336/678] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:52.557785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=11 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:52.558706 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=71 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:52.563386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1329253546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1851351781", "security_groups": [{"name": "tempest-secgroup-smoke-374758187"}], "networks": [{"uuid": "23ed595f-021e-4b49-9057-9caea24d9122"}], "block_device_mapping_v2": [{"uuid": "4ebe0bc5-ff45-4ffa-bc32-64c1c3ce5087", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:52.677096 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] validate_networks() for [('23ed595f-021e-4b49-9057-9caea24d9122', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:07:53.045847 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:07:53.046265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:07:53.046735 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:07:53.047135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:07:53.047538 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:07:53.056147 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:53.056616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:53.057399 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:53.057829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:53.075069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Getting quotas for project e608cc75a5ed4f05b462c84c29a31788. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:07:53.079678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Getting quotas for user f72d7744f4c4493a8e2a5f87e9a89d5c and project e608cc75a5ed4f05b462c84c29a31788. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:07:53.135121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:07:53.137233 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ebe0bc5-ff45-4ffa-bc32-64c1c3ce5087',volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:07:53.264166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d1e943d8-3ba4-4174-af8d-e66f1f2ad46c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.707241 Jul 15 14:07:53.264848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 343/679] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:07:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:07:53.272572 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:53.273903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:53.274469 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=33 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:07:53.279121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c2d83347-d31a-4e64-98fb-1940e01ca5fe tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:53.280418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c2d83347-d31a-4e64-98fb-1940e01ca5fe tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:53.335308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c2d83347-d31a-4e64-98fb-1940e01ca5fe tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:53.342441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c2d83347-d31a-4e64-98fb-1940e01ca5fe tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1089 microversion: 2.1 time: 0.070780 Jul 15 14:07:53.343206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 337/680] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:53 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:54.362629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:54.363525 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:54.371464 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:54.372080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:54.373424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:54.373865 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:54.448683 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:54.457529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a4a8d458-462f-405c-b0d9-98bb2538e6d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1205 microversion: 2.1 time: 0.100695 Jul 15 14:07:54.458119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 344/681] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:54 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1205 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:55.474047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:55.475341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:55.483275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:55.483791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:55.484617 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:55.485332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:55.621455 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:55.630030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3ac82210-1ff3-4cfd-8875-33cf4c1730d3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.159782 Jul 15 14:07:55.631072 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 338/682] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:55 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:07:55.929497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-1f65f70d-9ec1-49d8-9dea-cc2caaa68902 req-b5b5c634-b7ae-48a8-9dae-9ccd2032e4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:07:55.939962 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-1f65f70d-9ec1-49d8-9dea-cc2caaa68902 req-b5b5c634-b7ae-48a8-9dae-9ccd2032e4ac service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:55.940679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-1f65f70d-9ec1-49d8-9dea-cc2caaa68902 req-b5b5c634-b7ae-48a8-9dae-9ccd2032e4ac service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:55.962072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-1f65f70d-9ec1-49d8-9dea-cc2caaa68902 req-b5b5c634-b7ae-48a8-9dae-9ccd2032e4ac service nova] Creating event network-changed:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:07:55.968560 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-1f65f70d-9ec1-49d8-9dea-cc2caaa68902 req-b5b5c634-b7ae-48a8-9dae-9ccd2032e4ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042514 Jul 15 14:07:55.969738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 345/683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:07:56.647172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:56.647788 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:56.654709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:56.655480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:56.656274 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:56.656783 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:56.800542 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:56.808552 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0e3e6730-78f4-459d-8277-d628d9be7795 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.165078 Jul 15 14:07:56.809075 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 339/684] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:56 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:57.827926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:57.828705 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:57.835427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:57.835921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:57.836777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:57.837213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:57.976116 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:57.983984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7b50c951-b59f-4f68-a510-af2f5911eb63 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.161552 Jul 15 14:07:57.984597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 346/685] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:57 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:07:59.001092 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:07:59.001707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:07:59.009209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:59.009655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:59.010441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:07:59.010882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:07:59.154968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:07:59.162769 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-11c44386-814f-4ca5-bdbd-b9ace1344dd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.165623 Jul 15 14:07:59.163555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 340/686] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:07:58 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:00.179459 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:00.180068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:00.186814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:00.187262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:00.188030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:00.188497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:00.323536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:00.331020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-188609e4-1ec7-4ae0-a951-83042093cdf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.155465 Jul 15 14:08:00.331588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 347/687] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:00 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:01.347836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:01.348471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:01.355014 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:01.355468 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:01.356233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:01.356706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:01.495874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:01.504044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d1590af7-ec89-43ae-b6f9-6edc1078cefd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.160072 Jul 15 14:08:01.504641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 341/688] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:01 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:02.521121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:02.521673 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:02.528123 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:02.528609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:02.529880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:02.530313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:02.661271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:02.668640 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ce17fb14-020c-44a2-95a9-7d6c7df49bda tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.151396 Jul 15 14:08:02.669205 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 348/689] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:02 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:03.687359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:03.687961 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:03.690081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:03.695327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:03.695703 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:03.696491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:03.696925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:03.828502 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:03.835823 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-72e3f75d-7a55-42e4-a976-3d9370d598dd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.153752 Jul 15 14:08:03.836363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 342/690] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:03 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:04.851481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:04.852234 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:04.855222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:04.856002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:04.861890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:04.862336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:04.863114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:04.863541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:05.024046 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:05.038308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-91c55d79-036a-4197-ad4e-960ef1dc5515 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.190205 Jul 15 14:08:05.039383 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 349/691] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:04 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:08:06.055721 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:06.056353 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:06.064229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:06.064698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:06.065512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:06.066058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:06.204177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:06.211780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b094a044-5de0-46ca-b6fd-7ee4016903ee tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.160030 Jul 15 14:08:06.212350 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 343/692] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:06 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:06.969658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-f1bbb4ed-5e0a-42b8-9658-ed7afb6a1dbf req-c7e3fb9b-5b9a-4f6a-beee-0a15e876fb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "name": "network-vif-plugged", "status": "completed", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:06.978320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f1bbb4ed-5e0a-42b8-9658-ed7afb6a1dbf req-c7e3fb9b-5b9a-4f6a-beee-0a15e876fb1f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:06.979191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f1bbb4ed-5e0a-42b8-9658-ed7afb6a1dbf req-c7e3fb9b-5b9a-4f6a-beee-0a15e876fb1f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:06.991460 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-f1bbb4ed-5e0a-42b8-9658-ed7afb6a1dbf req-c7e3fb9b-5b9a-4f6a-beee-0a15e876fb1f service nova] Creating event network-vif-plugged:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:08:06.996625 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-f1bbb4ed-5e0a-42b8-9658-ed7afb6a1dbf req-c7e3fb9b-5b9a-4f6a-beee-0a15e876fb1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Jul 15 14:08:06.997429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 350/693] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:08:07.229529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:07.230133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:07.239220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:07.239788 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:07.240906 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:07.241654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:07.403605 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:07.411521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-152b244e-3e34-4ebc-8640-3a68b1bd1e5a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.185896 Jul 15 14:08:07.412110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 344/694] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:07 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:08.428945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:08.429562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:08.437009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:08.437456 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:08.438236 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:08.438678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:08.581610 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:08.589846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3de41494-6551-4a84-966c-59abab04cf87 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1260 microversion: 2.1 time: 0.165126 Jul 15 14:08:08.590426 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 351/695] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:08 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:08:08.995237 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:08.996215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:09.003993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.004575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.005366 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.005807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.039185 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ed335d00-adc3-4eba-b1d0-c570066e96d1 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047827 Jul 15 14:08:09.039750 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 345/696] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jul 15 14:08:08 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:09.100408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:09.100909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:09.108209 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.108687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.109461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.109896 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.135894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:08:09.215541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b9c74a42-d46b-4386-9e37-b97993b55f4f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 204 len: 0 microversion: 2.20 time: 0.118530 Jul 15 14:08:09.216070 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 352/697] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jul 15 14:08:09 2022] DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 14:08:09.224947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:09.225652 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:09.231527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.231984 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.233323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.233786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.367693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:09.375743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:09.377289 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:09.378450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1ea09641-47b2-444c-8e98-b04af24f7731 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.157418 Jul 15 14:08:09.379008 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 346/698] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:09 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:08:09.607795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:09.608518 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:09.615351 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.615802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.616610 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.617060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.758773 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:09.766899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e3c658c0-53be-4da6-9066-cca7625cceca tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1445 microversion: 2.1 time: 0.163462 Jul 15 14:08:09.767467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 353/699] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:09 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:09.783457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:09.784055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:09.790125 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.790566 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.791320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:09.791753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:09.928142 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:09.936252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5e4982b6-2343-4b05-952d-cae949117c35 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1445 microversion: 2.1 time: 0.156686 Jul 15 14:08:09.936850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 347/700] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:09 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:10.396286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:10.396922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:10.403068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:10.403524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:10.404338 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:10.404795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:10.641779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:10.650633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:10.652201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:10.653821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-afb627d1-e6a9-4664-9e2b-4492d6e0fab5 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1723 microversion: 2.20 time: 0.261079 Jul 15 14:08:10.654878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 354/701] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:10 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 14:08:11.569734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-a314f122-418f-42c6-8243-81836d8cec76 req-f11d79df-829a-4763-8122-7e4d645dc9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f26be6-7c18-4f85-bf8c-dfd0311b69d0", "name": "network-vif-deleted", "tag": "f363e19e-f4b1-40d5-a9a0-b2499a7aa619"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:11.586327 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-a314f122-418f-42c6-8243-81836d8cec76 req-f11d79df-829a-4763-8122-7e4d645dc9ca service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:11.586825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-a314f122-418f-42c6-8243-81836d8cec76 req-f11d79df-829a-4763-8122-7e4d645dc9ca service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:11.618568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-a314f122-418f-42c6-8243-81836d8cec76 req-f11d79df-829a-4763-8122-7e4d645dc9ca service nova] Creating event network-vif-deleted:f363e19e-f4b1-40d5-a9a0-b2499a7aa619 for instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 on hv-cinder-85000 Jul 15 14:08:11.632018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-a314f122-418f-42c6-8243-81836d8cec76 req-f11d79df-829a-4763-8122-7e4d645dc9ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067306 Jul 15 14:08:11.634266 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 348/702] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:11.686629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:11.687549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:11.704310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:11.705534 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:11.709287 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:11.711414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:11.785079 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:11.785926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:11.786686 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lazy-loading 'fault' on Instance uuid 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:08:11.835184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:11.850436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:11.851939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '520583af1f264f22a86722b0cb9ff405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160b9f06dad4ee98349dbc63131c20d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:11.853336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cd70a922-24fc-4ac8-ab28-7c2708938536 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 200 len: 1371 microversion: 2.20 time: 0.173772 Jul 15 14:08:11.864427 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 355/703] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:11 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 14:08:11.932199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-5e5fd5b2-9e99-42a9-9908-d360460837bf req-f27431b3-5a87-4b42-afd4-380a393c59b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:11.941245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5e5fd5b2-9e99-42a9-9908-d360460837bf req-f27431b3-5a87-4b42-afd4-380a393c59b4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:11.941685 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5e5fd5b2-9e99-42a9-9908-d360460837bf req-f27431b3-5a87-4b42-afd4-380a393c59b4 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:11.952603 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-5e5fd5b2-9e99-42a9-9908-d360460837bf req-f27431b3-5a87-4b42-afd4-380a393c59b4 service nova] Creating event network-changed:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:08:11.957756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-5e5fd5b2-9e99-42a9-9908-d360460837bf req-f27431b3-5a87-4b42-afd4-380a393c59b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029398 Jul 15 14:08:11.959500 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 349/704] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:12.874569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:12.875552 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:12.884244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:12.885409 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:12.886556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:12.887000 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:12.902781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 HTTP/1.1 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:12.904514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:12.906388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '12f26be6-7c18-4f85-bf8c-dfd0311b69d0'} Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:12.907681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:12.910309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:12.911924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:12.911924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ec75a4a4-4d07-4ef9-b27d-8f57b2f8c26f tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 404 len: 111 microversion: 2.20 time: 0.036139 Jul 15 14:08:12.911924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 356/705] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:12 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:12.917822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-eecfecf2-7d49-4ead-ab52-998fde238f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '.version_select at 0x7fa0c0feb9d0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:12.943431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-eecfecf2-7d49-4ead-ab52-998fde238f8b tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615591891" status: 204 len: 0 microversion: 2.20 time: 0.030009 Jul 15 14:08:12.947999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 350/706] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Jul 15 14:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615591891 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 14:08:14.777287 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:14.777819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:14.785523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:14.785523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:14.785913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:14.786351 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:14.803185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 HTTP/1.1 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:14.804793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.806874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '12f26be6-7c18-4f85-bf8c-dfd0311b69d0'} Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:14.807760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.809231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.811279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:14.811279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-87936e54-aa4f-4a0c-9268-ae361f94c717 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 404 len: 111 microversion: 2.20 time: 0.032807 Jul 15 14:08:14.811279 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 357/707] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jul 15 14:08:14 2022] DELETE /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:14.816237 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:14.816993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 12f26be6-7c18-4f85-bf8c-dfd0311b69d0] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:14.824549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:14.824997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:14.825765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:14.826209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:14.840658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 HTTP/1.1 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:14.842310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.843924 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '12f26be6-7c18-4f85-bf8c-dfd0311b69d0'} Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:14.844831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. Jul 15 14:08:14.846244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:14.847583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 12f26be6-7c18-4f85-bf8c-dfd0311b69d0 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:14.847583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d79b9274-63b8-40f2-b314-c3af0a7aa478 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0" status: 404 len: 111 microversion: 2.20 time: 0.032118 Jul 15 14:08:14.847583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 351/708] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:14 2022] GET /compute/v2.1/servers/12f26be6-7c18-4f85-bf8c-dfd0311b69d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:15.995117 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:15.995691 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:16.003008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:16.003457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:16.004231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:16.004714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:16.019632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b HTTP/1.1 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:16.021213 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.022872 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '2f497d21-0e38-4bee-8991-6aae2a4eae9b'} Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:16.023724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.025165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.026622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:16.026622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bd5c3d62-87ac-4df0-a5fe-f2e034d87855 tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 404 len: 111 microversion: 2.20 time: 0.031475 Jul 15 14:08:16.026622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 358/709] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jul 15 14:08:15 2022] DELETE /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:16.031293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:16.031907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] [instance: 2f497d21-0e38-4bee-8991-6aae2a4eae9b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:16.038442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:16.038918 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:16.039693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:16.040132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:16.054114 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] HTTP exception thrown: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Request method failure captured: Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b HTTP/1.1 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XMk_3AdCW-g0dWupBmgQq9KNMg0EXCxBvFu2gyWLqxZx--8vLutgySz3weBPOxurjKuExowfGyieK1UGkvBG0zuuRQWkn79_SDPbsN9UBALJC9A7B1GlmbVFYFyooJNes-nUWprs-bRSm0DEdlm3ixrSgeJCGLC8afK8rPY96b5VbY Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:16.055647 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c160b9f06dad4ee98349dbc63131c20d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c160b9f06dad4ee98349dbc63131c20d"}]}] Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c160b9f06dad4ee98349dbc63131c20d Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-38976668 Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 520583af1f264f22a86722b0cb9ff405 Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-38976668-project Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.057321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '2f497d21-0e38-4bee-8991-6aae2a4eae9b'} Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:16.058287 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. Jul 15 14:08:16.059932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:16.062058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] Returning 404 to user: Instance 2f497d21-0e38-4bee-8991-6aae2a4eae9b could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:16.062058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b5c2b0ae-1785-4fc6-884a-6f4d2b1bbd8d tempest-AttachVolumeShelveTestJSON-38976668 tempest-AttachVolumeShelveTestJSON-38976668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b" status: 404 len: 111 microversion: 2.20 time: 0.029730 Jul 15 14:08:16.062058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 352/710] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jul 15 14:08:16 2022] GET /compute/v2.1/servers/2f497d21-0e38-4bee-8991-6aae2a4eae9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:18.976155 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:18.979717 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:18.987280 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:18.987844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:18.988791 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:18.989207 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:19.021047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-524cb2ae-be5f-46fd-83d5-8875124a9115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.048763 Jul 15 14:08:19.021620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 359/711] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:08:18 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:20.485886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a2ee306-93fd-44e5-b0d1-3f4981df1103"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:20.486951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:20.493973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:20.494176 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:20.494953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:20.495398 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:20.779005 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1c05a41e-ce2e-4247-b6ed-e6e0d99918af tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296806 Jul 15 14:08:20.779510 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 353/712] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:08:20 2022] POST /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:20.881452 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-688e7806-2a6c-4e04-99ac-ab3384da7b36 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Action: 'create', calling method: .version_select at 0x7fa0c1169040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1752248865"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:21.218546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-688e7806-2a6c-4e04-99ac-ab3384da7b36 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.490604 Jul 15 14:08:21.219814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 360/713] 10.222.0.16 () {60 vars in 1154 bytes} [Fri Jul 15 14:08:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 493 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 15 14:08:21.234817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c34d377e-898c-4c35-895f-2996560d592c tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0faa310>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:21.285620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c34d377e-898c-4c35-895f-2996560d592c tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 200 len: 345 microversion: 2.1 time: 0.056642 Jul 15 14:08:21.286306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 354/714] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:21 2022] GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:22.299895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-843daa50-0596-4bf6-959f-3db686bd7991 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10a59d0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:22.347065 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-843daa50-0596-4bf6-959f-3db686bd7991 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 200 len: 346 microversion: 2.1 time: 0.051404 Jul 15 14:08:22.347627 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 361/715] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:22 2022] GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:22.359711 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ea9fbdde-10ab-4a78-913c-ec905afeb992 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Action: 'create', calling method: .version_select at 0x7fa0c0ff2790>, body: {"snapshot": {"volume_id": "e9eddef2-83f6-46e1-8692-80aa4612054e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1810416594"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:22.514394 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ea9fbdde-10ab-4a78-913c-ec905afeb992 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.159409 Jul 15 14:08:22.515019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 355/716] 10.222.0.16 () {60 vars in 1161 bytes} [Fri Jul 15 14:08:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:22.524953 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f71e9fff-bc0c-472f-9b89-371bf52bda52 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10a5790>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:22.559324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f71e9fff-bc0c-472f-9b89-371bf52bda52 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 287 microversion: 2.1 time: 0.038162 Jul 15 14:08:22.564602 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 362/717] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:22 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:22.571140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-66b1f403-4edd-4e69-968b-7d0968dd1b77 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c105cee0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:22.600936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-66b1f403-4edd-4e69-968b-7d0968dd1b77 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033697 Jul 15 14:08:22.601509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 356/718] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jul 15 14:08:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:22.612220 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dc85c962-41c9-485e-9fbb-db40b8b5e147 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c1151b80>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:22.641878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-dc85c962-41c9-485e-9fbb-db40b8b5e147 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 287 microversion: 2.1 time: 0.033614 Jul 15 14:08:22.642439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 363/719] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:22 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:23.654655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2526ef08-e9a9-446b-a491-1a7f4c22d591 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0ffa160>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:23.683857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2526ef08-e9a9-446b-a491-1a7f4c22d591 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 287 microversion: 2.1 time: 0.033982 Jul 15 14:08:23.684439 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 357/720] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:23 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:24.696062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d58500ea-e9bc-429c-bad9-47a758bea2d8 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10b65e0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:24.725334 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d58500ea-e9bc-429c-bad9-47a758bea2d8 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 287 microversion: 2.1 time: 0.033492 Jul 15 14:08:24.725909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 364/721] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:24 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:25.739520 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2406e5f0-3122-4071-a71c-4d03d90d7d97 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0f601f0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:25.774098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2406e5f0-3122-4071-a71c-4d03d90d7d97 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 288 microversion: 2.1 time: 0.040306 Jul 15 14:08:25.774676 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 358/722] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:25 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:25.785464 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-123c4c9b-e2bd-43ef-aa6f-2620605f9f1b tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10a5d30>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:25.850227 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-123c4c9b-e2bd-43ef-aa6f-2620605f9f1b tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 202 len: 0 microversion: 2.1 time: 0.069055 Jul 15 14:08:25.851029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 365/723] 10.222.0.16 () {58 vars in 1253 bytes} [Fri Jul 15 14:08:25 2022] DELETE /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:08:25.859477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9d5f6474-4432-4dae-bdf5-09ac21aef3e1 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0ffa160>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:25.891444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9d5f6474-4432-4dae-bdf5-09ac21aef3e1 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 200 len: 287 microversion: 2.1 time: 0.035734 Jul 15 14:08:25.892029 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 359/724] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:25 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:26.905149 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0782300c-e779-4a6f-8299-6cf87772d68e tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10b6dc0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:26.931526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-0782300c-e779-4a6f-8299-6cf87772d68e tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] HTTP exception thrown: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0782300c-e779-4a6f-8299-6cf87772d68e tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Request method failure captured: Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 HTTP/1.1 Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTUpTNNtJfb1GCwJ8jbW0usAJhE2H_cXVy78tyniuB2hChOtGBjEjiO_s9M6PokzMfRRZ9-HblSH2OnFM7068GJACUvIXkfDnPHi08q6tFp-83OEtTIY8A1MB4lw0ZsTZeiDx1Scp_WtFw76Sedh7TvmiMmYhzlI_xbCn_8UX6BafQ Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:26.933885 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0005c811375d4a55bb5bc2844103d24e"}]}] Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: c8dbb3b553a84b07b2d407af42116375 Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'ef6f64ac-dd1e-4b1a-ab00-93392021cbf7'} Jul 15 14:08:26.935574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. (HTTP 404) (Request-ID: req-308f303b-ac6c-4a5c-92f0-f55c342edc34) Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.936613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:26.938013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 15 14:08:26.940931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0782300c-e779-4a6f-8299-6cf87772d68e tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Returning 404 to user: Snapshot ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0782300c-e779-4a6f-8299-6cf87772d68e tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7" status: 404 len: 111 microversion: 2.1 time: 0.035255 Jul 15 14:08:26.942533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 366/725] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jul 15 14:08:26 2022] GET /compute/v2.1/os-snapshots/ef6f64ac-dd1e-4b1a-ab00-93392021cbf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:08:26.945935 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8a992212-912b-45b6-bf6f-00eb44509950 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0fd5c10>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:27.012692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8a992212-912b-45b6-bf6f-00eb44509950 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 202 len: 0 microversion: 2.1 time: 0.071358 Jul 15 14:08:27.013907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 360/726] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:08:26 2022] DELETE /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:08:27.022925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-79e5f380-9d6f-4487-9e10-699121180854 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10a5940>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:27.084971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-79e5f380-9d6f-4487-9e10-699121180854 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 200 len: 345 microversion: 2.1 time: 0.066061 Jul 15 14:08:27.085556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 367/727] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:27 2022] GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:27.309381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6c5fbd6c-567b-474c-a31c-ea41fd4d8049 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: .version_select at 0x7fa0c105cee0>, body: {"keypair": {"name": "tempest-keypair-1280913184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPycWIjQs/lOB6c2nnBGEshjlFeT7q0ruQ4I/S9uKwpe8lYhEQ/5SZw7lIo22lKISiK8KbmX2yM5fzL1TmbfGyawv1K2QzAcDd1mzttZjvuGhqH7uKDrrj0pmK8wR8m36A=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:27.315644 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:27.328786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-6c5fbd6c-567b-474c-a31c-ea41fd4d8049 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:08:27.333000 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-6c5fbd6c-567b-474c-a31c-ea41fd4d8049 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:08:27.356271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6c5fbd6c-567b-474c-a31c-ea41fd4d8049 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050723 Jul 15 14:08:27.356956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 361/728] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:08:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:28.101289 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-31133595-699c-4eeb-8a4f-ceec6b289d76 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10b6310>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:28.130628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-31133595-699c-4eeb-8a4f-ceec6b289d76 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] HTTP exception thrown: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-31133595-699c-4eeb-8a4f-ceec6b289d76 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Request method failure captured: Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e HTTP/1.1 Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTUpTNNtJfb1GCwJ8jbW0usAJhE2H_cXVy78tyniuB2hChOtGBjEjiO_s9M6PokzMfRRZ9-HblSH2OnFM7068GJACUvIXkfDnPHi08q6tFp-83OEtTIY8A1MB4lw0ZsTZeiDx1Scp_WtFw76Sedh7TvmiMmYhzlI_xbCn_8UX6BafQ Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:28.132596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0005c811375d4a55bb5bc2844103d24e"}]}] Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: c8dbb3b553a84b07b2d407af42116375 Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'e9eddef2-83f6-46e1-8692-80aa4612054e'} Jul 15 14:08:28.134202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. (HTTP 404) (Request-ID: req-957875a3-10a0-4e3b-a61d-954d1a3e944b) Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.135232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:28.136458 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 14:08:28.137632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-31133595-699c-4eeb-8a4f-ceec6b289d76 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Returning 404 to user: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-31133595-699c-4eeb-8a4f-ceec6b289d76 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 404 len: 109 microversion: 2.1 time: 0.039079 Jul 15 14:08:28.139085 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 368/729] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:28 2022] GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:08:28.145991 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0ea0bb72-6d02-4233-9380-555a80223cc6 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c0ffa8b0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:28.176591 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-0ea0bb72-6d02-4233-9380-555a80223cc6 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] HTTP exception thrown: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0ea0bb72-6d02-4233-9380-555a80223cc6 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Request method failure captured: Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e HTTP/1.1 Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XTUpTNNtJfb1GCwJ8jbW0usAJhE2H_cXVy78tyniuB2hChOtGBjEjiO_s9M6PokzMfRRZ9-HblSH2OnFM7068GJACUvIXkfDnPHi08q6tFp-83OEtTIY8A1MB4lw0ZsTZeiDx1Scp_WtFw76Sedh7TvmiMmYhzlI_xbCn_8UX6BafQ Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:28.180234 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0005c811375d4a55bb5bc2844103d24e"}]}] Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: c8dbb3b553a84b07b2d407af42116375 Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'e9eddef2-83f6-46e1-8692-80aa4612054e'} Jul 15 14:08:28.181796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. (HTTP 404) (Request-ID: req-5de501e7-3a18-432c-b7b0-6962a7e4b00e) Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.186067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:28.187620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 14:08:28.189091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0ea0bb72-6d02-4233-9380-555a80223cc6 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Returning 404 to user: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0ea0bb72-6d02-4233-9380-555a80223cc6 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 404 len: 109 microversion: 2.1 time: 0.040535 Jul 15 14:08:28.190517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 362/730] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:08:28 2022] DELETE /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:08:28.191490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11541ea8-f612-40aa-aea5-bb513fbe6357 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Calling method '.version_select at 0x7fa0c10bc940>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:28.224604 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-11541ea8-f612-40aa-aea5-bb513fbe6357 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] HTTP exception thrown: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11541ea8-f612-40aa-aea5-bb513fbe6357 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Request method failure captured: Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e HTTP/1.1 Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTUpTNNtJfb1GCwJ8jbW0usAJhE2H_cXVy78tyniuB2hChOtGBjEjiO_s9M6PokzMfRRZ9-HblSH2OnFM7068GJACUvIXkfDnPHi08q6tFp-83OEtTIY8A1MB4lw0ZsTZeiDx1Scp_WtFw76Sedh7TvmiMmYhzlI_xbCn_8UX6BafQ Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:28.226848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0005c811375d4a55bb5bc2844103d24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0005c811375d4a55bb5bc2844103d24e"}]}] Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 0005c811375d4a55bb5bc2844103d24e Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-192638147 Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: c8dbb3b553a84b07b2d407af42116375 Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-192638147-project Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'e9eddef2-83f6-46e1-8692-80aa4612054e'} Jul 15 14:08:28.228303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. (HTTP 404) (Request-ID: req-0a3c9459-b030-41a5-80d9-c41545f9a077) Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.229301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:28.230431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 14:08:28.231547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-11541ea8-f612-40aa-aea5-bb513fbe6357 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] Returning 404 to user: Volume e9eddef2-83f6-46e1-8692-80aa4612054e could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-11541ea8-f612-40aa-aea5-bb513fbe6357 tempest-VolumesSnapshotsTestJSON-192638147 tempest-VolumesSnapshotsTestJSON-192638147-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e" status: 404 len: 109 microversion: 2.1 time: 0.042147 Jul 15 14:08:28.235007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 369/731] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:28 2022] GET /compute/v2.1/os-volumes/e9eddef2-83f6-46e1-8692-80aa4612054e => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:08:28.700503 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2047118441", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98015688-617a-4c97-89d4-c0de9e353bb5"}], "security_groups": [{"name": "tempest-securitygroup--1306479778"}], "key_name": "tempest-keypair-1280913184", "user_data": "}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:28.816714 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] validate_networks() for [('98015688-617a-4c97-89d4-c0de9e353bb5', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:08:29.321251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:08:29.321844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:08:29.322263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:08:29.323006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:08:29.323460 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:08:29.332998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:29.333680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:29.334551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:29.335024 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:29.342394 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:29.356427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:08:29.365007 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:08:29.376900 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:08:29.379297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:08:29.426473 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-329ffb4f-5a1e-431e-a4f3-1e353d8ba646 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730360 Jul 15 14:08:29.427354 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 363/732] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:08:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 14:08:29.433868 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:29.434675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:29.438889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-61c87ca6-1f1d-4839-998d-07539e7c30b2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:29.439503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-61c87ca6-1f1d-4839-998d-07539e7c30b2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:29.533535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-61c87ca6-1f1d-4839-998d-07539e7c30b2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:29.540969 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-61c87ca6-1f1d-4839-998d-07539e7c30b2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1242 microversion: 2.1 time: 0.107837 Jul 15 14:08:29.541538 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 370/733] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:29 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:29.739145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f13b1068-5051-46e2-bcbb-f91655d86aae tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Action: 'create', calling method: .version_select at 0x7fa0c0febee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-895716539", "metadata": {"Type": "work"}}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f13b1068-5051-46e2-bcbb-f91655d86aae tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 121 Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:29.765477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-895716539", "metadata": {"Type": "work"}}} Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: Jul 15 14:08:29.767156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-895716539', 'metadata': {'Type': 'work'}}}} Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise error Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi '#$%' Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.768223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 14:08:29.770049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 14:08:29.771483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 14:08:29.771483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.771483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f13b1068-5051-46e2-bcbb-f91655d86aae tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.771483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f13b1068-5051-46e2-bcbb-f91655d86aae tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151920 Jul 15 14:08:29.771483 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 364/734] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jul 15 14:08:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:29.777228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-283ff62e-1d34-4965-afa3-52c4756c2f9e tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Action: 'create', calling method: .version_select at 0x7fa0c10a5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-929982015", "metadata": {"Type": "work"}}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-283ff62e-1d34-4965-afa3-52c4756c2f9e tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 119 Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:29.781222 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-929982015", "metadata": {"Type": "work"}}} Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:29.782566 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-929982015', 'metadata': {'Type': 'work'}}}} Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise error Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi '0' Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.783500 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 14:08:29.784895 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 14:08:29.786021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 14:08:29.786021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.786021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-283ff62e-1d34-4965-afa3-52c4756c2f9e tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.786021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-283ff62e-1d34-4965-afa3-52c4756c2f9e tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009271 Jul 15 14:08:29.786021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 371/735] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jul 15 14:08:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:29.792446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e066b3dc-6a83-4044-a2e9-2a447bfb4ac6 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Action: 'create', calling method: .version_select at 0x7fa0c0faaf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-277442825", "metadata": {"Type": "work"}}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e066b3dc-6a83-4044-a2e9-2a447bfb4ac6 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 118 Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:29.794763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-277442825", "metadata": {"Type": "work"}}} Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: Jul 15 14:08:29.796430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-277442825', 'metadata': {'Type': 'work'}}}} Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise error Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi '' Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.797674 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 14:08:29.799733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 14:08:29.801410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 14:08:29.801410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.801410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e066b3dc-6a83-4044-a2e9-2a447bfb4ac6 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.801410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e066b3dc-6a83-4044-a2e9-2a447bfb4ac6 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007451 Jul 15 14:08:29.801410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 365/736] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jul 15 14:08:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:08:29.806942 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-15b0d4f7-aee1-4963-9949-5e497171004c tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Calling method '.version_select at 0x7fa0c105ba60>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:29.838388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-15b0d4f7-aee1-4963-9949-5e497171004c tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] HTTP exception thrown: Volume tempest-invalid-2033140200 could not be found. Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-15b0d4f7-aee1-4963-9949-5e497171004c tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2033140200 HTTP/1.1 Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:29.841029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Volume tempest-invalid-2033140200 could not be found. Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'tempest-invalid-2033140200'} Jul 15 14:08:29.843244 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2033140200 could not be found. (HTTP 404) (Request-ID: req-7603efd4-a73d-46cd-8d7a-7084dccc9a28) Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.844122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:29.845603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2033140200 could not be found. Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:29.846933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2033140200 could not be found. Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2033140200 could not be found. Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-15b0d4f7-aee1-4963-9949-5e497171004c tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 404 to user: Volume tempest-invalid-2033140200 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-15b0d4f7-aee1-4963-9949-5e497171004c tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2033140200" status: 404 len: 99 microversion: 2.1 time: 0.040306 Jul 15 14:08:29.848712 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 372/737] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jul 15 14:08:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2033140200 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 15 14:08:29.855486 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0696009d-1f1e-406a-b0ee-95fe444278fe tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004020 Jul 15 14:08:29.855962 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 366/738] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jul 15 14:08:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 14:08:29.865704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1af47cda-f945-4f79-9faf-35f71b72c3b5 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003867 Jul 15 14:08:29.866232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 373/739] 10.222.0.16 () {58 vars in 1136 bytes} [Fri Jul 15 14:08:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 14:08:29.880442 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-84c9887e-19ea-4c0c-85d1-327312a8ed9b tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Calling method '.version_select at 0x7fa0c1086ee0>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:29.914447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-84c9887e-19ea-4c0c-85d1-327312a8ed9b tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] HTTP exception thrown: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-84c9887e-19ea-4c0c-85d1-327312a8ed9b tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/os-volumes/09599935-8c6a-47d1-9c5d-1252789055a6 HTTP/1.1 Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:08:29.916509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '09599935-8c6a-47d1-9c5d-1252789055a6'} Jul 15 14:08:29.918148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. (HTTP 404) (Request-ID: req-72ff39b2-5e0d-4479-b2bb-b9c0f6c9867f) Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.919141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 14:08:29.920606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 14:08:29.922030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-84c9887e-19ea-4c0c-85d1-327312a8ed9b tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 404 to user: Volume 09599935-8c6a-47d1-9c5d-1252789055a6 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-84c9887e-19ea-4c0c-85d1-327312a8ed9b tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/09599935-8c6a-47d1-9c5d-1252789055a6" status: 404 len: 109 microversion: 2.1 time: 0.045783 Jul 15 14:08:29.923559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 367/740] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:08:29 2022] DELETE /compute/v2.1/os-volumes/09599935-8c6a-47d1-9c5d-1252789055a6 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:08:29.932923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3c0fbefb-e6d1-4704-84c1-a4f3e5d7f569 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Calling method '.version_select at 0x7fa0c10d6790>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:29.963554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-3c0fbefb-e6d1-4704-84c1-a4f3e5d7f569 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] HTTP exception thrown: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3c0fbefb-e6d1-4704-84c1-a4f3e5d7f569 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Request method failure captured: Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/os-volumes/e70bf5b9-cccc-479e-925e-a658ce797688 HTTP/1.1 Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XTdXXIDWwGzkjd3zykBdRbitp_aaeJBqizjRFTGkE3tJhkfdmRCWva60d9EJ63lBsjeYO64LYhEhWiTvqXBvY_SOLwRV0y2RA5BBrTPdVGqzY5o7ix71vdvmSMWxcgYNG6EU39-9NNYoa_QPjiBsMUtddl9M-l6OWSYSC2kT6C84tQ Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:08:29.965596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5881caf60e042a0badab3d6dba4da7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5881caf60e042a0badab3d6dba4da7b"}]}] Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: c5881caf60e042a0badab3d6dba4da7b Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesNegativeTest-1193913562 Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: eb3572c2dece45abbba432dc286d7503 Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesNegativeTest-1193913562-project Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'e70bf5b9-cccc-479e-925e-a658ce797688'} Jul 15 14:08:29.973477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. (HTTP 404) (Request-ID: req-f8ee45d5-9604-4976-8c17-07815bc48a72) Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.974412 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 14:08:29.975714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 14:08:29.977203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3c0fbefb-e6d1-4704-84c1-a4f3e5d7f569 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] Returning 404 to user: Volume e70bf5b9-cccc-479e-925e-a658ce797688 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3c0fbefb-e6d1-4704-84c1-a4f3e5d7f569 tempest-VolumesNegativeTest-1193913562 tempest-VolumesNegativeTest-1193913562-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e70bf5b9-cccc-479e-925e-a658ce797688" status: 404 len: 109 microversion: 2.1 time: 0.038836 Jul 15 14:08:29.978531 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 374/741] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jul 15 14:08:29 2022] GET /compute/v2.1/os-volumes/e70bf5b9-cccc-479e-925e-a658ce797688 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:08:30.561338 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:30.562429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:30.571330 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:30.572687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:30.573490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:30.574355 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:30.663119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:30.672065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-af3eb707-df2c-465c-b09a-74e8891b743e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1300 microversion: 2.1 time: 0.116466 Jul 15 14:08:30.672775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 368/742] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:30 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:31.691121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:31.692272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:31.699393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:31.699852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:31.700799 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:31.701423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:31.863699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:31.871941 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6fcd459d-00c6-444b-a906-4e83f9642c8c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.186245 Jul 15 14:08:31.872744 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 375/743] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:31 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:32.351954 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-d371dbcd-78c4-414f-88bf-1788e597857c req-c2b72771-69cb-47fd-be2b-02a83442eec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b75964-be8c-4cda-b4da-d9156a8b65fc", "tag": "bf9cdbb3-3ca5-4ea9-b03c-b329339421be"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:32.367152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-d371dbcd-78c4-414f-88bf-1788e597857c req-c2b72771-69cb-47fd-be2b-02a83442eec9 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:32.367598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-d371dbcd-78c4-414f-88bf-1788e597857c req-c2b72771-69cb-47fd-be2b-02a83442eec9 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:32.387374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-d371dbcd-78c4-414f-88bf-1788e597857c req-c2b72771-69cb-47fd-be2b-02a83442eec9 service nova] Creating event network-changed:bf9cdbb3-3ca5-4ea9-b03c-b329339421be for instance f7b75964-be8c-4cda-b4da-d9156a8b65fc on hv-cinder-85000 Jul 15 14:08:32.395510 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-d371dbcd-78c4-414f-88bf-1788e597857c req-c2b72771-69cb-47fd-be2b-02a83442eec9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047645 Jul 15 14:08:32.396586 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 369/744] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:32.890092 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:32.890702 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:32.897252 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:32.897694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:32.898455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:32.898892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:33.029779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:33.037182 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0096e9f8-6f18-408d-a7c0-6f7d7e3386d5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.151011 Jul 15 14:08:33.037750 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 376/745] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:32 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:34.055529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:34.056229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:34.066040 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:34.066645 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:34.067490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:34.068036 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:34.201720 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:34.209294 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a79573a3-4232-4531-8130-842940cca070 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.158466 Jul 15 14:08:34.209862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 370/746] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:34 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:35.226124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:35.226955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:35.233533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:35.234061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:35.234926 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:35.235721 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:35.383643 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:35.391874 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0a47d6a8-f5ca-414d-95e7-3e832df21767 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.169695 Jul 15 14:08:35.392469 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 377/747] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:35 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:36.408990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:36.409597 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:36.416199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:36.416607 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:36.417384 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:36.417819 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:36.548060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:36.555584 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9a200710-b12c-4c92-90ba-48e64cb1a20a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.150499 Jul 15 14:08:36.556148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 371/748] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:36 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:37.573438 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:37.574090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:37.581200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:37.581651 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:37.582483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:37.582928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:37.728869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:37.737492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4e79f4ba-4e08-4999-89b3-9ec3878b4afd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.167871 Jul 15 14:08:37.738074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 378/749] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:37 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:38.609299 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-74421b11-e91c-428b-8ad8-50e418a6ce70 req-9cd990d6-ae6f-40db-8e9a-ce3f12ccb265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b75964-be8c-4cda-b4da-d9156a8b65fc", "name": "network-vif-plugged", "status": "completed", "tag": "bf9cdbb3-3ca5-4ea9-b03c-b329339421be"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:38.619114 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-74421b11-e91c-428b-8ad8-50e418a6ce70 req-9cd990d6-ae6f-40db-8e9a-ce3f12ccb265 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:38.619911 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-74421b11-e91c-428b-8ad8-50e418a6ce70 req-9cd990d6-ae6f-40db-8e9a-ce3f12ccb265 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:38.640671 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-74421b11-e91c-428b-8ad8-50e418a6ce70 req-9cd990d6-ae6f-40db-8e9a-ce3f12ccb265 service nova] Creating event network-vif-plugged:bf9cdbb3-3ca5-4ea9-b03c-b329339421be for instance f7b75964-be8c-4cda-b4da-d9156a8b65fc on hv-cinder-85000 Jul 15 14:08:38.646166 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-74421b11-e91c-428b-8ad8-50e418a6ce70 req-9cd990d6-ae6f-40db-8e9a-ce3f12ccb265 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040790 Jul 15 14:08:38.647192 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 372/750] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:38.755584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:38.756571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:38.763806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:38.764896 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:38.765902 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:38.766578 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:38.920290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:38.929654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5ef67df7-6372-4776-94db-180e573e6904 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.177724 Jul 15 14:08:38.930136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 379/751] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:38 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:39.952562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:39.953317 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=10 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:39.958187 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:39.958915 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:39.965914 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:39.966385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:39.967139 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:39.967562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:40.105383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:40.113387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b1374c9c-b86b-4fbd-8d40-f99d0ffa0b13 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1368 microversion: 2.1 time: 0.162423 Jul 15 14:08:40.113953 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 373/752] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:39 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:08:41.130842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:41.131478 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:41.133337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:08:41.139580 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:41.140030 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:41.140843 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:41.141277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:41.272164 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:08:41.280514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b62586b4-f4c3-496e-9220-10d194dd19ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1558 microversion: 2.1 time: 0.153420 Jul 15 14:08:41.281046 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 380/753] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:08:41 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:08:41.296728 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:08:41.297334 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:08:41.303537 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:41.303986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:41.304786 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:41.305222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:41.387077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-eccbadda-035b-4732-805b-a8a1bd6d4734 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094426 Jul 15 14:08:41.387756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 374/754] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:08:41 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:08:42.617338 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-b3458c1a-ba16-428b-a79f-46cbc3c4cd6f req-a78b410f-ff98-43d7-b63d-dbf1de8d1c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b75964-be8c-4cda-b4da-d9156a8b65fc", "tag": "bf9cdbb3-3ca5-4ea9-b03c-b329339421be"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:08:42.626501 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b3458c1a-ba16-428b-a79f-46cbc3c4cd6f req-a78b410f-ff98-43d7-b63d-dbf1de8d1c1d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:08:42.627198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b3458c1a-ba16-428b-a79f-46cbc3c4cd6f req-a78b410f-ff98-43d7-b63d-dbf1de8d1c1d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:08:42.638954 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-b3458c1a-ba16-428b-a79f-46cbc3c4cd6f req-a78b410f-ff98-43d7-b63d-dbf1de8d1c1d service nova] Creating event network-changed:bf9cdbb3-3ca5-4ea9-b03c-b329339421be for instance f7b75964-be8c-4cda-b4da-d9156a8b65fc on hv-cinder-85000 Jul 15 14:08:42.644471 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-b3458c1a-ba16-428b-a79f-46cbc3c4cd6f req-a78b410f-ff98-43d7-b63d-dbf1de8d1c1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030667 Jul 15 14:08:42.645360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 381/755] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:06.863601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:06.865023 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=33 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:07.092317 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-14036cc4-9d56-410b-8baf-36dc70d80de5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Action: 'create', calling method: .version_select at 0x7fa0c0faa3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-786946882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEkW0/UBdM8ALsjixgjYwWR8OgteS/rxY4uvEUTFfaA20QahOEHW/xKKV2YE8WoF6AhONRPU8rxEf7HEJrxi19l9BoFCqQyidw2lv7gqiiB2QDcfQWzT93VPscQIDAPNw=="}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:07.108323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-14036cc4-9d56-410b-8baf-36dc70d80de5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:09:07.116979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-14036cc4-9d56-410b-8baf-36dc70d80de5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for user 1e956289b0e64cc892d453f427845d71 and project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'key_pairs'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:09:07.156529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-14036cc4-9d56-410b-8baf-36dc70d80de5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.294204 Jul 15 14:09:07.157147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 375/756] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:09:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:18.771069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=18 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:18.771823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=38 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:18.776475 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:18.777061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:18.784320 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.784786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.785540 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.785968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.810265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4697af02-d5e1-44b2-9a04-672e3a1016c2 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.041848 Jul 15 14:09:18.810837 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 382/757] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:09:18 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:18.819148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:18.819952 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:18.823891 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a2ee306-93fd-44e5-b0d1-3f4981df1103"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:18.824973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:18.833432 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.833887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.834707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.835147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.917807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: POST /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/os-volume_attachments HTTP/1.1 Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 74 Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:09:18.919532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {"volumeAttachment": {"volumeId": "2a2ee306-93fd-44e5-b0d1-3f4981df1103"}} Jul 15 14:09:18.921844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'server_id': 'f7b75964-be8c-4cda-b4da-d9156a8b65fc', 'body': {'volumeAttachment': {'volumeId': '2a2ee306-93fd-44e5-b0d1-3f4981df1103'}}} Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:18.922858 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:18.924407 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 400 to user: Invalid volume: volume 2a2ee306-93fd-44e5-b0d1-3f4981df1103 is already attached to instances: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-52703cb5-2913-400f-9027-0358bc937f9d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103801 Jul 15 14:09:18.926019 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 376/758] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:09:18 2022] POST /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 15 14:09:18.930344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:18.930841 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:18.937007 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.937451 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.938214 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:18.938658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:18.963740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:09:19.038308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e3f860ba-f239-4a6c-8bfa-4a36f184c5ed tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 204 len: 0 microversion: 2.1 time: 0.111567 Jul 15 14:09:19.039013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 383/759] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:09:18 2022] DELETE /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 14:09:19.049162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:19.049774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:19.055825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:19.056277 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:19.057086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:19.057527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:19.193212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:19.200760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-67037ae0-e91d-49a5-838f-18af2c6b954e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1683 microversion: 2.1 time: 0.156410 Jul 15 14:09:19.201313 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 377/760] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:19 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:20.219045 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:20.219733 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:20.226161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:20.226609 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:20.227370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:20.227806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:20.364135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:20.371562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-53bb570c-59df-40d1-a65b-7eb2763017ae tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1683 microversion: 2.1 time: 0.156892 Jul 15 14:09:20.372119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 384/761] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:20 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:21.388605 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:21.389269 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:21.396035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:21.396507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:21.397279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:21.397707 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:21.468212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:21.475809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ffd032e5-2d86-4cda-a96b-c574c1b24d48 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 200 len: 1615 microversion: 2.1 time: 0.091141 Jul 15 14:09:21.476379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 378/762] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:21 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:09:21.696577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-9dbb95fb-443b-48b1-9460-dfc4151a5f1b req-e49975a7-8844-4c48-9ec6-1dc965f1d329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b75964-be8c-4cda-b4da-d9156a8b65fc", "name": "network-vif-deleted", "tag": "bf9cdbb3-3ca5-4ea9-b03c-b329339421be"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:21.706615 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-9dbb95fb-443b-48b1-9460-dfc4151a5f1b req-e49975a7-8844-4c48-9ec6-1dc965f1d329 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:21.707053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-9dbb95fb-443b-48b1-9460-dfc4151a5f1b req-e49975a7-8844-4c48-9ec6-1dc965f1d329 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:21.720014 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-9dbb95fb-443b-48b1-9460-dfc4151a5f1b req-e49975a7-8844-4c48-9ec6-1dc965f1d329 service nova] Creating event network-vif-deleted:bf9cdbb3-3ca5-4ea9-b03c-b329339421be for instance f7b75964-be8c-4cda-b4da-d9156a8b65fc on hv-cinder-85000 Jul 15 14:09:21.725370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-9dbb95fb-443b-48b1-9460-dfc4151a5f1b req-e49975a7-8844-4c48-9ec6-1dc965f1d329 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Jul 15 14:09:21.725971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 385/763] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:22.493121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:22.493729 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:22.500929 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:22.501377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:22.502137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:22.502572 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:22.516465 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc HTTP/1.1 Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:09:22.518148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:09:22.519587 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'f7b75964-be8c-4cda-b4da-d9156a8b65fc'} Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:09:22.520404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:09:22.522323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:09:22.524043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:09:22.524043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-49abc533-07b1-4207-a95c-bb46ffe33d23 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 404 len: 111 microversion: 2.1 time: 0.030132 Jul 15 14:09:22.524043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 379/764] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:22 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:09:22.529364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e65e75e6-d6b8-4add-b91d-fed5f5987a79 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '.version_select at 0x7fa0c111a4c0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:22.549446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e65e75e6-d6b8-4add-b91d-fed5f5987a79 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280913184" status: 202 len: 0 microversion: 2.1 time: 0.024276 Jul 15 14:09:22.550044 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 386/765] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jul 15 14:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280913184 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:09:23.252471 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:23.252965 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:23.258931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:23.259381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:23.260140 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:23.260620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:23.340585 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lazy-loading 'services' on Instance uuid 5f8b8d9e-553e-4193-aaf6-1f599d5282bc {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:09:23.412677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f54f92d3-311c-4b76-90c5-142c7ab6dbef tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments/2a2ee306-93fd-44e5-b0d1-3f4981df1103" status: 202 len: 0 microversion: 2.1 time: 0.163948 Jul 15 14:09:23.413257 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 380/766] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:09:23 2022] DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments/2a2ee306-93fd-44e5-b0d1-3f4981df1103 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:09:23.422232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:23.423199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:23.430262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:23.430731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:23.431498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:23.432173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:23.467527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b5943f49-f575-4b60-8ffe-bb61293617e6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049810 Jul 15 14:09:23.468101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 387/767] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:09:23 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:23.751270 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1998767557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786946882", "security_groups": [{"name": "tempest-secgroup-smoke-245232798"}], "block_device_mapping_v2": [{"uuid": "24207ddd-c94d-4ecf-bb7f-b4e4e7ccb88e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "83416a30-2d17-494b-808c-bdf0235bc309"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:23.867273 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] validate_networks() for [('83416a30-2d17-494b-808c-bdf0235bc309', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:09:24.273400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:09:24.273807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:09:24.274272 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:09:24.275554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:09:24.276017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:09:24.286998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.288477 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.289282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.289743 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.309132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:09:24.314301 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for user 1e956289b0e64cc892d453f427845d71 and project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:09:24.373169 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:09:24.375356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24207ddd-c94d-4ecf-bb7f-b4e4e7ccb88e',volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:09:24.479223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:24.480247 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:24.487208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.487732 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.488537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.488974 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.506806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c8a1c351-9691-428c-86d8-dbc1df832b73 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761201 Jul 15 14:09:24.507703 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 381/768] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:09:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:09:24.518171 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5107fc2c-2b0f-4acc-b0cc-61e2ce1ae180 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:24.518791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5107fc2c-2b0f-4acc-b0cc-61e2ce1ae180 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:24.518997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-58a195bf-df3b-4047-a5bb-cddeffce032a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043757 Jul 15 14:09:24.519749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 388/769] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:09:24 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 14:09:24.582817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5107fc2c-2b0f-4acc-b0cc-61e2ce1ae180 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:24.584745 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:24.585242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:24.590391 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5107fc2c-2b0f-4acc-b0cc-61e2ce1ae180 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1094 microversion: 2.1 time: 0.076293 Jul 15 14:09:24.591308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 382/770] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:24 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:09:24.591660 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.592725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.593699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.594136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.620086 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:09:24.714665 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5c5e0fdf-e9cd-49da-830a-64fdae172ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 204 len: 0 microversion: 2.1 time: 0.133102 Jul 15 14:09:24.715791 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 389/771] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:09:24 2022] DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 14:09:24.729325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:24.730373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:24.740673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.741441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.742691 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:24.743415 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:24.888478 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:24.896598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-17ea9a68-a149-4565-9355-dc4765fc30c1 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1681 microversion: 2.1 time: 0.173661 Jul 15 14:09:24.897359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 383/772] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:24 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:25.608690 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:25.609393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:25.616162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:25.616647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:25.617435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:25.617857 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:25.684071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:25.692090 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c1c9cad9-ac0e-42c3-880f-ceabda8a0247 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1144 microversion: 2.1 time: 0.087682 Jul 15 14:09:25.692684 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 390/773] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:25 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:25.914167 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:25.914823 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:25.921383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:25.921840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:25.922606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:25.923047 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:26.053067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:26.060528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-eb229e61-29d7-440c-9631-75f7324f98f4 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1681 microversion: 2.1 time: 0.150383 Jul 15 14:09:26.061112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 384/774] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:25 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:26.709275 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:26.709884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:26.716808 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:26.717943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:26.718732 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:26.719175 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:26.804914 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:26.813603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c00822aa-a2c6-4fd9-bb06-3300575d3cf8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1192 microversion: 2.1 time: 0.108264 Jul 15 14:09:26.823042 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 391/775] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:26 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:27.080262 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:27.080926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:27.087669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:27.088219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:27.089108 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:27.089602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:27.225136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:27.232572 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7582849a-50e1-47fc-b7fa-684b7cbe965e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1681 microversion: 2.1 time: 0.158253 Jul 15 14:09:27.233175 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 385/776] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:27 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:27.831060 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:27.831670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:27.838386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:27.838824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:27.841208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:27.841208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:27.904166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:27.913309 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-881675b6-3b0a-40ee-8304-ae87ab05dc8b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1198 microversion: 2.1 time: 0.085986 Jul 15 14:09:27.913858 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 392/777] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:27 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:28.087670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-5933cc8f-89ff-41d9-8aaf-2a10010ec8d6 req-a3b57624-03d1-4724-a8f0-7138f071d28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8b8d9e-553e-4193-aaf6-1f599d5282bc", "name": "network-vif-deleted", "tag": "08923a84-8b04-41f6-8ada-897d5d2d5a5e"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:28.100106 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5933cc8f-89ff-41d9-8aaf-2a10010ec8d6 req-a3b57624-03d1-4724-a8f0-7138f071d28d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.100582 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5933cc8f-89ff-41d9-8aaf-2a10010ec8d6 req-a3b57624-03d1-4724-a8f0-7138f071d28d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:28.131767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-5933cc8f-89ff-41d9-8aaf-2a10010ec8d6 req-a3b57624-03d1-4724-a8f0-7138f071d28d service nova] Creating event network-vif-deleted:08923a84-8b04-41f6-8ada-897d5d2d5a5e for instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc on hv-cinder-85000 Jul 15 14:09:28.139903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-5933cc8f-89ff-41d9-8aaf-2a10010ec8d6 req-a3b57624-03d1-4724-a8f0-7138f071d28d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063783 Jul 15 14:09:28.140978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 386/778] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:28.251396 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:28.252341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:28.262838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.263484 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:28.265167 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.265814 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:28.305964 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.306647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:28.307489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lazy-loading 'fault' on Instance uuid 5f8b8d9e-553e-4193-aaf6-1f599d5282bc {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:09:28.358056 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:28.369720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ef25e421-dbca-48c0-97fa-0af1d6e44161 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 200 len: 1331 microversion: 2.1 time: 0.122215 Jul 15 14:09:28.370635 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 393/779] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:28 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:28.937283 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:28.938982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:28.949357 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.958375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:28.959795 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:28.960568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:29.137148 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:29.150861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9178a082-81de-4a0b-ba2f-6592cd98c7e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.223361 Jul 15 14:09:29.153156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 387/780] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:28 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:29.387323 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:29.387987 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:29.396650 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:29.397114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:29.397894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:29.398335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:29.413094 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc HTTP/1.1 Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:09:29.414747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:09:29.416468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '5f8b8d9e-553e-4193-aaf6-1f599d5282bc'} Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:09:29.417416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:09:29.418997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:09:29.421337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:09:29.421337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-18219be7-5efc-4bce-bf4a-2556308c2d7b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 404 len: 111 microversion: 2.1 time: 0.032847 Jul 15 14:09:29.421337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 394/781] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:29 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:09:29.426622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e95cef1a-767c-4253-8079-18a61eddce14 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '.version_select at 0x7fa0c0f3f280>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:29.444692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e95cef1a-767c-4253-8079-18a61eddce14 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202889508" status: 202 len: 0 microversion: 2.1 time: 0.021723 Jul 15 14:09:29.445278 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 388/782] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jul 15 14:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202889508 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:09:30.065169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fe279e2d-5dd6-46e8-bd20-217adb9869b3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: .version_select at 0x7fa0c1074430>, body: {"keypair": {"name": "tempest-keypair-648041960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnHZowWiWUhNRHDNzeP4IkXDymy9ZhjnEB6IypRJAB4d/pWfOinfbHczQkFWJWgI2s+NMFJvC7uehbs0g3DMJMrar3OJriUsC6gKUURiEvhpEeAmVuW3pfehCZey3cS3g=="}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:30.080192 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-fe279e2d-5dd6-46e8-bd20-217adb9869b3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:09:30.084002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-fe279e2d-5dd6-46e8-bd20-217adb9869b3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:09:30.105363 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fe279e2d-5dd6-46e8-bd20-217adb9869b3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044140 Jul 15 14:09:30.105946 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 395/783] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:09:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:30.167557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:30.168202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:30.177787 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:30.178254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:30.179095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:30.179542 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:30.199821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-ad37281b-8f94-431c-88ac-57fa881f062f req-63f9a000-6957-4e4a-b5ff-497108f19d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8235719c-04b4-4277-8340-90cfffc0c9bf", "tag": "a779e437-fe42-45e9-8ed5-72bfececf241"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:30.208935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ad37281b-8f94-431c-88ac-57fa881f062f req-63f9a000-6957-4e4a-b5ff-497108f19d3d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:30.209432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ad37281b-8f94-431c-88ac-57fa881f062f req-63f9a000-6957-4e4a-b5ff-497108f19d3d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:30.221648 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-ad37281b-8f94-431c-88ac-57fa881f062f req-63f9a000-6957-4e4a-b5ff-497108f19d3d service nova] Creating event network-changed:a779e437-fe42-45e9-8ed5-72bfececf241 for instance 8235719c-04b4-4277-8340-90cfffc0c9bf on hv-cinder-85000 Jul 15 14:09:30.227171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-ad37281b-8f94-431c-88ac-57fa881f062f req-63f9a000-6957-4e4a-b5ff-497108f19d3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Jul 15 14:09:30.230931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 396/784] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:30.369161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:30.378030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-33b26baf-910c-4c03-a531-9088ad55e2cd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.214702 Jul 15 14:09:30.378777 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 389/785] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:30 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:31.402019 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:31.402708 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:31.409923 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:31.410352 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:31.411124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:31.411598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:31.616106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:31.624287 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d2a73cd8-38b6-4b51-9914-84123ed1dfef tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.227615 Jul 15 14:09:31.624881 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 397/786] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:31 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:31.678909 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-240504289", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98015688-617a-4c97-89d4-c0de9e353bb5"}], "security_groups": [{"name": "tempest-securitygroup--388443339"}], "key_name": "tempest-keypair-648041960", "user_data": "}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:31.778739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] validate_networks() for [('98015688-617a-4c97-89d4-c0de9e353bb5', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:09:32.141482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:09:32.141901 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:09:32.142365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:09:32.142765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:09:32.143172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:09:32.151967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:32.152432 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:32.153216 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:32.153644 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:32.170756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:09:32.174715 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:09:32.185712 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:09:32.188644 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:09:32.234020 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5c05ebbf-f5c7-4a32-9287-e805c872e7fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.559218 Jul 15 14:09:32.234623 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 390/787] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:09:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:09:32.244893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b2bb2055-0e3b-4b38-ad45-0cd696fd06c9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:32.245508 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b2bb2055-0e3b-4b38-ad45-0cd696fd06c9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:32.301555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b2bb2055-0e3b-4b38-ad45-0cd696fd06c9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:32.308344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b2bb2055-0e3b-4b38-ad45-0cd696fd06c9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1240 microversion: 2.1 time: 0.067338 Jul 15 14:09:32.309052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 398/788] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:32 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:32.641132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:32.641838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:32.648155 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:32.648657 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:32.649536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:32.649988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:32.822704 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:32.830995 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bb9b04fd-1f6d-4e01-a2c9-67208349746a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.193715 Jul 15 14:09:32.831461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 391/789] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:32 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:33.326089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:33.327257 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:33.334984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:33.335431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:33.336416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:33.337044 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:33.399529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:33.407229 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0636e92e-0b91-455b-b100-3236c553fa65 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1298 microversion: 2.1 time: 0.085105 Jul 15 14:09:33.407798 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 399/790] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:33 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:09:33.849828 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:33.850682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:33.858277 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:33.858865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:33.859941 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:33.860485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:34.056896 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:34.064946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bd1cc2a0-f5c8-4dc6-ac10-06d05aed46c0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.220778 Jul 15 14:09:34.065517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 392/791] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:33 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:34.425015 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:34.425656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:34.433076 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:34.433529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:34.434315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:34.434821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:34.440433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:34.573223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:34.581350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a9a1de7d-ab33-4a39-9d6c-5c82286b6fa0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.160762 Jul 15 14:09:34.581925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 400/792] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:34 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:34.869104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-573527be-bd5a-4f57-a274-b1fee2722f8c req-379fc286-8fb0-4358-a4f0-4d31d61f1ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c4ebb6-f959-401d-b3f8-66ee92d1a98c", "tag": "1a2551e3-419a-4496-9970-b2a5ddcff131"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:34.880071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-573527be-bd5a-4f57-a274-b1fee2722f8c req-379fc286-8fb0-4358-a4f0-4d31d61f1ce5 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:34.880845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-573527be-bd5a-4f57-a274-b1fee2722f8c req-379fc286-8fb0-4358-a4f0-4d31d61f1ce5 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:34.897757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-573527be-bd5a-4f57-a274-b1fee2722f8c req-379fc286-8fb0-4358-a4f0-4d31d61f1ce5 service nova] Creating event network-changed:1a2551e3-419a-4496-9970-b2a5ddcff131 for instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c on hv-cinder-85000 Jul 15 14:09:34.903641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-573527be-bd5a-4f57-a274-b1fee2722f8c req-379fc286-8fb0-4358-a4f0-4d31d61f1ce5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038928 Jul 15 14:09:34.907666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 393/793] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:35.081811 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:35.082423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:35.088551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:35.089002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:35.089774 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:35.090221 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:35.235359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:35.243729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6c0da681-4e96-4498-85fb-15fa5efe1de2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.166095 Jul 15 14:09:35.244313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 401/794] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:35 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:35.599364 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:35.600185 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:35.606527 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:35.607004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:35.608429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:35.608875 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:35.747396 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:35.754796 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f7da1de1-f737-40cb-b37d-863412b4849c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.159682 Jul 15 14:09:35.755447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 394/795] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:35 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:36.261214 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:36.261819 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:36.269143 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:36.269585 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:36.270348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:36.270777 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:36.406713 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:36.414247 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-149962ab-1dee-4334-ba5b-b59252be3db3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.156799 Jul 15 14:09:36.414743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 402/796] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:36 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:36.771340 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:36.771940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:36.778532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:36.778975 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:36.779731 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:36.780887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:36.920227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:36.928887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-67a1e831-794f-4fcf-b183-9f1719d0a9e8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.160879 Jul 15 14:09:36.929467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 395/797] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:36 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:37.432087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:37.432681 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:37.440764 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:37.442136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:37.442728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:37.443505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:37.589492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:37.598237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9c4be0a0-0e2c-467d-a7ff-6c535ff92440 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.170528 Jul 15 14:09:37.598833 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 403/798] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:37 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:37.946612 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:37.947363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:37.954677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:37.955177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:37.955977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:37.956452 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:38.104991 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:38.115268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7849cc04-e85c-4022-8f0e-125a6d85c0b0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.172238 Jul 15 14:09:38.115895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 396/799] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:37 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:09:38.615957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:38.616603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:38.623069 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:38.623536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:38.624308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:38.624771 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:38.776472 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:38.786448 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ec75e829-21c5-4777-a682-5d3a3248a734 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.174327 Jul 15 14:09:38.787046 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 404/800] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:38 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:38.958958 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-886b895e-5b7c-4a4f-9e66-110417621133 req-179bd06e-6a8a-48c5-a974-00d9f7d63dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8235719c-04b4-4277-8340-90cfffc0c9bf", "name": "network-vif-plugged", "status": "completed", "tag": "a779e437-fe42-45e9-8ed5-72bfececf241"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:38.968515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-886b895e-5b7c-4a4f-9e66-110417621133 req-179bd06e-6a8a-48c5-a974-00d9f7d63dd1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:38.968960 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-886b895e-5b7c-4a4f-9e66-110417621133 req-179bd06e-6a8a-48c5-a974-00d9f7d63dd1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:38.973223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:38.982225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-886b895e-5b7c-4a4f-9e66-110417621133 req-179bd06e-6a8a-48c5-a974-00d9f7d63dd1 service nova] Creating event network-vif-plugged:a779e437-fe42-45e9-8ed5-72bfececf241 for instance 8235719c-04b4-4277-8340-90cfffc0c9bf on hv-cinder-85000 Jul 15 14:09:38.987514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-886b895e-5b7c-4a4f-9e66-110417621133 req-179bd06e-6a8a-48c5-a974-00d9f7d63dd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032297 Jul 15 14:09:38.988112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 397/801] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:39.131503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:39.132113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:39.138437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:39.139121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:39.140863 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:39.141435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:39.276967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:39.284848 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-14d5d994-5ff0-458d-bd97-d2d730c1f815 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.157156 Jul 15 14:09:39.288434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 405/802] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:39 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:39.803767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:39.804490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:39.811618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:39.812063 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:39.812846 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:39.813279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:39.947010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:39.955361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-af69835d-95e7-41c0-83f0-916b99c31947 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1265 microversion: 2.1 time: 0.155788 Jul 15 14:09:39.955926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 398/803] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:39 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:40.302127 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:40.302846 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:40.309573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:40.310028 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:40.310817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:40.311852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:40.458571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:40.465869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d8b7d15a-b888-4c67-9458-01f23cae1ba5 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.167738 Jul 15 14:09:40.466424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 406/804] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:40 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:40.972947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:40.973626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:40.980666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:40.981129 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:40.981887 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:40.982383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.018944 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-f3e2ddd5-8765-4efe-981b-aca9bf008492 req-cb010ca4-b859-49ac-9090-5994a2551d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c4ebb6-f959-401d-b3f8-66ee92d1a98c", "name": "network-vif-plugged", "status": "completed", "tag": "1a2551e3-419a-4496-9970-b2a5ddcff131"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:41.027415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f3e2ddd5-8765-4efe-981b-aca9bf008492 req-cb010ca4-b859-49ac-9090-5994a2551d8c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:41.027760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f3e2ddd5-8765-4efe-981b-aca9bf008492 req-cb010ca4-b859-49ac-9090-5994a2551d8c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.040307 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-f3e2ddd5-8765-4efe-981b-aca9bf008492 req-cb010ca4-b859-49ac-9090-5994a2551d8c service nova] Creating event network-vif-plugged:1a2551e3-419a-4496-9970-b2a5ddcff131 for instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c on hv-cinder-85000 Jul 15 14:09:41.045241 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-f3e2ddd5-8765-4efe-981b-aca9bf008492 req-cb010ca4-b859-49ac-9090-5994a2551d8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030995 Jul 15 14:09:41.045865 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 407/805] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:09:41.128997 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:41.139071 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b40b130f-b835-4bd3-b934-885b30eccf2e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1452 microversion: 2.1 time: 0.170081 Jul 15 14:09:41.140837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 399/806] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:40 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:41.157747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:41.159120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:41.168161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:41.168655 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.169523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:41.169956 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.312200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:41.320021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-62ad1869-733b-456b-90cc-68fe64125a2b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1452 microversion: 2.1 time: 0.167420 Jul 15 14:09:41.320647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 408/807] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:41 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:09:41.485829 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:41.486856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:41.493873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:41.494494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.495418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:41.495947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:41.651265 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:41.659099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1a520245-571a-4e9b-977b-387395155630 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1365 microversion: 2.1 time: 0.177099 Jul 15 14:09:41.659749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 400/808] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:41 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:42.676905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:42.677899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:42.680197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:42.687936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:42.688522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:42.689376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:42.689818 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:42.838948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:09:42.847121 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-33009749-8b34-440f-a217-8435d8e4a0b7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1554 microversion: 2.1 time: 0.175264 Jul 15 14:09:42.847943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 409/809] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:09:42 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:09:42.865156 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:09:42.865727 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:09:42.868069 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:42.868830 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=14 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:09:42.875778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:42.876235 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:42.877079 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:42.877512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:42.962910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3af83c1f-48fd-4425-9e5a-fe726d0d7d1a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101828 Jul 15 14:09:42.963501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 401/810] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:09:42 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:43.129372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-0e6746d3-b270-494d-b22a-f3c6bc20f516 req-1722f60c-17dc-4dc1-b4d0-3a4a7ed952a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8235719c-04b4-4277-8340-90cfffc0c9bf", "tag": "a779e437-fe42-45e9-8ed5-72bfececf241"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:43.138713 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0e6746d3-b270-494d-b22a-f3c6bc20f516 req-1722f60c-17dc-4dc1-b4d0-3a4a7ed952a1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:43.139968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-0e6746d3-b270-494d-b22a-f3c6bc20f516 req-1722f60c-17dc-4dc1-b4d0-3a4a7ed952a1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:43.157434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-0e6746d3-b270-494d-b22a-f3c6bc20f516 req-1722f60c-17dc-4dc1-b4d0-3a4a7ed952a1 service nova] Creating event network-changed:a779e437-fe42-45e9-8ed5-72bfececf241 for instance 8235719c-04b4-4277-8340-90cfffc0c9bf on hv-cinder-85000 Jul 15 14:09:43.168617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-0e6746d3-b270-494d-b22a-f3c6bc20f516 req-1722f60c-17dc-4dc1-b4d0-3a4a7ed952a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043709 Jul 15 14:09:43.169653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 410/811] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:09:44.231015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-6b392c13-4b99-4272-b257-20c94fc90fc6 req-70579396-2490-4c18-8308-141b29fb8d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c4ebb6-f959-401d-b3f8-66ee92d1a98c", "tag": "1a2551e3-419a-4496-9970-b2a5ddcff131"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:09:44.240095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-6b392c13-4b99-4272-b257-20c94fc90fc6 req-70579396-2490-4c18-8308-141b29fb8d4b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:09:44.240574 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-6b392c13-4b99-4272-b257-20c94fc90fc6 req-70579396-2490-4c18-8308-141b29fb8d4b service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:09:44.254881 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-6b392c13-4b99-4272-b257-20c94fc90fc6 req-70579396-2490-4c18-8308-141b29fb8d4b service nova] Creating event network-changed:1a2551e3-419a-4496-9970-b2a5ddcff131 for instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c on hv-cinder-85000 Jul 15 14:09:44.260693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-6b392c13-4b99-4272-b257-20c94fc90fc6 req-70579396-2490-4c18-8308-141b29fb8d4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033663 Jul 15 14:09:44.261988 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 402/812] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:09.955431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:09.956200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=56 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:09.960377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:09.961029 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:09.969132 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:09.969592 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:09.970386 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:09.970824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:09.998433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lazy-loading 'flavor' on Instance uuid 1a999d1e-a17a-4ea9-8f71-3a981b55733b {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:10:10.075284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e5a3192b-ae4c-4b04-8bf4-37be3aaeca29 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "POST /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b/action" status: 202 len: 0 microversion: 2.1 time: 0.121297 Jul 15 14:10:10.075891 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 411/813] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:10:09 2022] POST /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:10:10.083577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:10.084434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=24 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:10.088888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:10.089912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:10.101173 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:10.101619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:10.102402 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:10.102840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:10.244982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:10.253305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-29e82ebf-4b1e-4325-8962-f8b3c551637c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.171643 Jul 15 14:10:10.253882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 403/814] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:10 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:11.272011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:11.272753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:11.279172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:11.279616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:11.280415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:11.281371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:11.432261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:11.440114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-07027766-c4c5-4ace-abb8-d0b6cbd48cdc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.172686 Jul 15 14:10:11.440737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 412/815] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:11 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:12.469882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:12.470431 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:12.477238 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:12.477673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:12.478453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:12.478886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:12.622296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:12.630629 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-37adf8eb-7ff7-475f-9fbf-512783394bd0 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.165841 Jul 15 14:10:12.631300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 404/816] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:12 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:13.647996 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:13.648632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:13.660166 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:13.660844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:13.661725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:13.662162 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:13.806457 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:13.816228 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-20680aa9-21a5-4c25-b81c-d6a0a9ba5f6e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.172037 Jul 15 14:10:13.816855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 413/817] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:13 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:14.833906 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:14.834493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:14.841209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:14.841648 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:14.842394 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:14.842825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:15.130119 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:15.137781 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-66bd145c-059c-44ed-b884-04412aa88c78 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.307851 Jul 15 14:10:15.138351 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 405/818] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:14 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:16.156720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:16.157265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:16.163844 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:16.164359 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:16.165157 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:16.165597 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:16.311087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:16.318729 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-86611f78-7cd6-4398-a70a-1a422128c5ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.166519 Jul 15 14:10:16.319298 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 414/819] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:16 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:17.336324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:17.337004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:17.343628 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:17.344698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:17.345481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:17.345919 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:17.488113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:17.496316 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5a81974f-3764-4979-b492-e531353789b8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.163819 Jul 15 14:10:17.496929 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 406/820] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:17 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:18.513534 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:18.514136 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:18.521344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:18.521785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:18.522554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:18.522986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:18.659804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:18.667394 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-590a4218-304e-4b60-b83b-256b3ac4a544 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.157661 Jul 15 14:10:18.667963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 415/821] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:18 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:19.684536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:19.685123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:19.691825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:19.692264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:19.693073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:19.693507 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:19.861752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:19.869817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ea5f4d27-1843-4e58-8f07-810450d1e38e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.189065 Jul 15 14:10:19.870400 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 407/822] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:19 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:20.358436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:20.358927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:20.366078 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:20.366528 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:20.367290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:20.367726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:20.391081 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a0f67e46-5548-4062-8dca-5fbe38e6e27d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/ips" status: 200 len: 148 microversion: 2.1 time: 0.036393 Jul 15 14:10:20.392154 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 416/823] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:10:20 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:20.897749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:20.898973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:20.906305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:20.906695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:20.907474 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:20.907921 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:21.052640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:21.060413 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a58af085-ee3a-4191-80b4-41eb0c880dc8 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.166995 Jul 15 14:10:21.061152 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 408/824] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:20 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:21.737890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ebeeef7-e8d3-48f5-834e-38da33035054"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:21.739021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:21.745855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:21.746315 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:21.747100 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:21.747541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:22.080460 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:22.081275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:22.089812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:22.090430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:22.091315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:22.091762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:22.229956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:22.238812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c7835d4f-cea0-4cb5-88ee-2523eea4f577 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.163887 Jul 15 14:10:22.239467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 409/825] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:22 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:22.617242 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ef64388e-fbf3-4e37-ac3b-40c4dd262a0a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883591 Jul 15 14:10:22.617849 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 417/826] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:10:21 2022] POST /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:10:23.256559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:23.257320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:23.264899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:23.265412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:23.267009 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:23.267423 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:23.434606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:23.443089 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1b2f45de-60bb-45d7-8861-c821b475baf6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.190673 Jul 15 14:10:23.443682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 410/827] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:23 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:24.461543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:24.462152 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:24.468361 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.469468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.470248 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.470679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.604113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:24.612316 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7b6d5ea5-07b4-4b3f-97c4-8fdc9dbe62ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1511 microversion: 2.1 time: 0.155484 Jul 15 14:10:24.612922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 418/828] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:24 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:24.628839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:24.629421 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:24.636100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.636696 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.637514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.637950 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.719876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-156d82f2-9fdf-497d-8b16-76913037b90e tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "POST /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b/action" status: 202 len: 0 microversion: 2.1 time: 0.094454 Jul 15 14:10:24.720422 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 411/829] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jul 15 14:10:24 2022] POST /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 14:10:24.728569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:24.729185 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:24.736995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.737762 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.739073 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:24.739588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:24.948285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:24.956921 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-222ed09c-7ee1-4eae-8af8-6c96ffbc5f4c tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1519 microversion: 2.1 time: 0.232121 Jul 15 14:10:24.957788 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 419/830] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:24 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:25.975640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:25.976289 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:25.982779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:25.983232 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:25.984023 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:25.985035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:26.128491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:26.142680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6643f5cb-aad8-4b88-bd79-1790c06510c5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1521 microversion: 2.1 time: 0.171016 Jul 15 14:10:26.143759 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 412/831] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:25 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:26.974056 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-f03a12f8-3d64-4cfa-95eb-b41554a730bd req-69beaa71-f333-4888-a30a-2e1b2c4ed5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "name": "network-vif-unplugged", "status": "completed", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:26.983403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f03a12f8-3d64-4cfa-95eb-b41554a730bd req-69beaa71-f333-4888-a30a-2e1b2c4ed5f9 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:26.983971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-f03a12f8-3d64-4cfa-95eb-b41554a730bd req-69beaa71-f333-4888-a30a-2e1b2c4ed5f9 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:26.997151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.compute.server_external_events [req-f03a12f8-3d64-4cfa-95eb-b41554a730bd req-69beaa71-f333-4888-a30a-2e1b2c4ed5f9 service nova] Unable to find a host for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b. Dropping event network-vif-unplugged {{(pid=117861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 14:10:26.998026 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-f03a12f8-3d64-4cfa-95eb-b41554a730bd req-69beaa71-f333-4888-a30a-2e1b2c4ed5f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027826 Jul 15 14:10:26.998612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 420/832] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 15 14:10:27.161406 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:27.162096 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:27.168782 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:27.169224 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:27.170016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:27.170443 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:27.305637 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:27.314183 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-864f3e02-3048-4d4e-b265-d9754ad637d6 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1521 microversion: 2.1 time: 0.156780 Jul 15 14:10:27.314799 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 413/833] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:27 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:28.331901 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:28.332535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:28.338906 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:28.339348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:28.340102 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:28.340591 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:28.469725 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:28.477293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3d4aecff-85a0-4879-815f-df81acddf342 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1521 microversion: 2.1 time: 0.149712 Jul 15 14:10:28.477869 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 421/834] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:28 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:29.494502 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:29.495200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:29.501600 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:29.502080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:29.502854 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:29.503295 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:29.642553 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:29.650656 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-98b6fde7-e932-436e-b564-8837379d603a tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1521 microversion: 2.1 time: 0.159971 Jul 15 14:10:29.651206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 414/835] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:29 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:30.144408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ebeeef7-e8d3-48f5-834e-38da33035054"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:30.145545 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:30.151993 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.152473 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.153239 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.153703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.233803 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: POST /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments HTTP/1.1 Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 74 Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:10:30.235582 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {"volumeAttachment": {"volumeId": "4ebeeef7-e8d3-48f5-834e-38da33035054"}} Jul 15 14:10:30.237431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'server_id': 'e7c4ebb6-f959-401d-b3f8-66ee92d1a98c', 'body': {'volumeAttachment': {'volumeId': '4ebeeef7-e8d3-48f5-834e-38da33035054'}}} Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:10:30.238357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:30.239634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 400 to user: Invalid volume: volume 4ebeeef7-e8d3-48f5-834e-38da33035054 is already attached to instances: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-61d2021b-8081-4350-a305-fd62b7ef8454 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097698 Jul 15 14:10:30.240982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 422/836] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:10:30 2022] POST /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 14:10:30.299018 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:30.299419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:30.305501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.305945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.306702 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.307133 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.389293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lazy-loading 'services' on Instance uuid e7c4ebb6-f959-401d-b3f8-66ee92d1a98c {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:10:30.462555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-26cd4af4-1125-4ba9-a7a9-397bd53b96a0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments/4ebeeef7-e8d3-48f5-834e-38da33035054" status: 202 len: 0 microversion: 2.1 time: 0.167327 Jul 15 14:10:30.463248 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 415/837] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:10:30 2022] DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments/4ebeeef7-e8d3-48f5-834e-38da33035054 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:10:30.471550 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:30.472596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:30.480013 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.480573 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.481677 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.482658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.515560 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-215d3bde-1b8c-4f64-bf2e-7d3961531276 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047967 Jul 15 14:10:30.516909 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 423/838] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:10:30 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:30.668406 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:30.669161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:30.675978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.676463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.677347 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:30.677834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:30.817866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:30.826131 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-84d9a9f6-926c-4cda-ac0d-3d0aa541324d tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.162545 Jul 15 14:10:30.826719 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 416/839] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:30 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:31.527333 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:31.528358 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:31.535624 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.536067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.536860 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.537303 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.564988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b41b9a7a-dfed-4130-a0a5-1a677a40709c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041744 Jul 15 14:10:31.565527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 424/840] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:10:31 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:10:31.623838 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:31.624333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:31.631095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.631540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.632325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.632783 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.659376 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:10:31.662132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:31.751719 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7b8c2363-8847-4a6d-9000-ef23cf8b8f42 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 204 len: 0 microversion: 2.1 time: 0.131374 Jul 15 14:10:31.752870 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 417/841] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:10:31 2022] DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:10:31.762340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:31.763497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:31.770875 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.771319 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.772105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.772574 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.777259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:31.846665 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:31.847865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:31.858516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.859325 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.861299 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:31.862354 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:31.966365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:31.975415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-165fdd59-cccb-4cb8-a7ee-31e1dedfbccb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1678 microversion: 2.1 time: 0.217590 Jul 15 14:10:31.976009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 425/842] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:31 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:32.040206 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:32.049463 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a64ef970-b1fa-4cff-9041-eb2c02dfa329 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.208188 Jul 15 14:10:32.050059 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 418/843] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:31 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:32.993106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:32.995335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:33.001194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:33.001658 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:33.002435 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:33.002870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:33.067300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:33.067915 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:33.074555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:33.075094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:33.076077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:33.076215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:33.179854 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:33.187807 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c15a000b-bc21-4e45-b26c-95330f1e073a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1678 microversion: 2.1 time: 0.198593 Jul 15 14:10:33.198327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 426/844] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:32 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:33.241359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:33.249077 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a81f274a-e311-4041-a914-93f4268aa3ac tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.185752 Jul 15 14:10:33.249692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 419/845] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:33 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:34.206012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:34.206728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:34.216425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:34.217011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:34.217853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:34.218372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:34.268635 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:34.269793 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:34.278039 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:34.278694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:34.280104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:34.280905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:34.288379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:34.296536 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-feb3c980-c1df-42a3-90df-633f7b437ca7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 200 len: 1611 microversion: 2.1 time: 0.094336 Jul 15 14:10:34.298439 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 427/846] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:34 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 1611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:34.434831 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:34.444426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d57e482e-0bcf-40cb-914a-ad43e7823237 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.181828 Jul 15 14:10:34.445024 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 420/847] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:34 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:34.518827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-37cb4812-6772-4e31-8a77-8e38b69ff103 req-54d1ea00-2172-496d-9ec2-cd1b2c531cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c4ebb6-f959-401d-b3f8-66ee92d1a98c", "name": "network-vif-deleted", "tag": "1a2551e3-419a-4496-9970-b2a5ddcff131"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:34.534281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-37cb4812-6772-4e31-8a77-8e38b69ff103 req-54d1ea00-2172-496d-9ec2-cd1b2c531cbc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:34.535078 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-37cb4812-6772-4e31-8a77-8e38b69ff103 req-54d1ea00-2172-496d-9ec2-cd1b2c531cbc service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:34.557918 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-37cb4812-6772-4e31-8a77-8e38b69ff103 req-54d1ea00-2172-496d-9ec2-cd1b2c531cbc service nova] Creating event network-vif-deleted:1a2551e3-419a-4496-9970-b2a5ddcff131 for instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c on hv-cinder-85000 Jul 15 14:10:34.566908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-37cb4812-6772-4e31-8a77-8e38b69ff103 req-54d1ea00-2172-496d-9ec2-cd1b2c531cbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054667 Jul 15 14:10:34.574020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 428/848] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:10:35.321683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:35.323834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:35.332691 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:35.333130 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:35.334003 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:35.334457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:35.350293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c HTTP/1.1 Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:10:35.352095 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:10:35.353664 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'e7c4ebb6-f959-401d-b3f8-66ee92d1a98c'} Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:10:35.358672 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:10:35.360030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:10:35.361279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:10:35.361279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-54c987c2-50b2-49e7-90d7-ef44ac18bf71 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 404 len: 111 microversion: 2.1 time: 0.039700 Jul 15 14:10:35.361279 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 421/849] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:35 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:10:35.366123 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-de189484-22e4-4f7c-8aa8-c1c200a89e32 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '.version_select at 0x7fa0c1087ee0>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:35.387654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-de189484-22e4-4f7c-8aa8-c1c200a89e32 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648041960" status: 202 len: 0 microversion: 2.1 time: 0.027489 Jul 15 14:10:35.388237 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 429/850] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jul 15 14:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648041960 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:10:35.471050 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:35.471682 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:35.486734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:35.487511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:35.488904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:35.489684 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:35.681116 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:35.692909 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0533e968-396e-4a78-acd0-7fcb8d44bc97 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.225011 Jul 15 14:10:35.703282 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 422/851] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:35 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:36.191934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8bf4df07-b486-4335-a2c9-31581f75a104 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: .version_select at 0x7fa0c105b700>, body: {"keypair": {"name": "tempest-keypair-1011301810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnFjOJXWXJ3a2ROehQsc1uTCqhtjPKnyckLTuiMW4UMwT881IEiNi8E8gwjBB57KrWAuURoiQldCZHVRpJ0rVHgMfsVOfRMAkLMeHqE27Xgf/vsLkmccaM3KGZc9ZWqCw=="}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:36.208781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-8bf4df07-b486-4335-a2c9-31581f75a104 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:10:36.212905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-8bf4df07-b486-4335-a2c9-31581f75a104 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'key_pairs'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:10:36.244805 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8bf4df07-b486-4335-a2c9-31581f75a104 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057167 Jul 15 14:10:36.245479 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 430/852] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jul 15 14:10:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:36.711986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:36.712742 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:36.720104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:36.720601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:36.721414 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:36.721861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:36.959026 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:36.968437 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-40ba5612-1b89-4457-b7ad-f5bae5da91e9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.260672 Jul 15 14:10:36.969028 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 423/853] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:36 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:37.740742 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984676663", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98015688-617a-4c97-89d4-c0de9e353bb5"}], "security_groups": [{"name": "tempest-securitygroup--1219811344"}], "key_name": "tempest-keypair-1011301810", "user_data": "}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:37.860300 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] validate_networks() for [('98015688-617a-4c97-89d4-c0de9e353bb5', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:10:37.987801 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:37.988548 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:37.998544 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:37.999210 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:38.001136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:38.001901 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:38.266592 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:38.279347 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c806a80d-168b-4140-a90c-35041edebde2 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.296075 Jul 15 14:10:38.280723 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 424/854] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:37 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:38.404505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:10:38.409009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:10:38.409009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:10:38.409009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:10:38.409009 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:10:38.416704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:38.417161 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:38.417970 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:38.418413 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:38.437176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:10:38.441855 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Getting quotas for user 4a3a211465a0478994d011f89eaf972f and project 26daacf03c844ff8a7546dfe3b36d8bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:10:38.454838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:10:38.457383 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:10:38.508505 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [9368f294-2122-4c44-be9a-7031c93e20b8] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 14:10:39.298197 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:39.298809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:39.305374 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:39.305824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:39.306596 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:39.307034 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:39.453359 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:39.461300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3df02aec-21f4-4a13-bd4d-535f5f3b4411 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.167020 Jul 15 14:10:39.461886 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 425/855] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:39 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:39.518337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [9368f294-2122-4c44-be9a-7031c93e20b8] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34478. Jul 15 14:10:39.524336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fc624b6f-c992-4a50-bb8a-5c5ad6a4eb4d tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.788617 Jul 15 14:10:39.525714 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 431/856] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:10:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:10:39.545296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-24634a73-2bec-4cfe-8da2-0b4b94423dd6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:39.546577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-24634a73-2bec-4cfe-8da2-0b4b94423dd6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:39.617559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-24634a73-2bec-4cfe-8da2-0b4b94423dd6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:39.628760 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-24634a73-2bec-4cfe-8da2-0b4b94423dd6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1242 microversion: 2.1 time: 0.094756 Jul 15 14:10:39.629899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 426/857] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:39 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:40.486368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:40.487158 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:40.489377 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:40.496140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:40.496596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:40.497571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:40.498031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:40.648529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:40.650078 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:40.658641 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:40.659906 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:40.668259 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:40.668783 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:40.669668 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:40.670195 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:40.672159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8d6886a5-9ea4-4e7c-b7b9-fccd56a2a7bc tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.190507 Jul 15 14:10:40.672832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 432/858] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:40 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:40.751464 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:40.765764 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-16943054-0c90-48b1-a271-3c7c8d9d608e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1300 microversion: 2.1 time: 0.124068 Jul 15 14:10:40.767379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 427/859] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:40 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:41.114084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-4badbf2f-9555-4344-9f78-a2f52f541ad6 req-23b32422-eb1e-4211-9c8c-e8bd55d8a216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "name": "network-vif-plugged", "status": "completed", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:41.126898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-4badbf2f-9555-4344-9f78-a2f52f541ad6 req-23b32422-eb1e-4211-9c8c-e8bd55d8a216 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:41.127765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-4badbf2f-9555-4344-9f78-a2f52f541ad6 req-23b32422-eb1e-4211-9c8c-e8bd55d8a216 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:41.144198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-4badbf2f-9555-4344-9f78-a2f52f541ad6 req-23b32422-eb1e-4211-9c8c-e8bd55d8a216 service nova] Creating event network-vif-plugged:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:10:41.149908 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-4badbf2f-9555-4344-9f78-a2f52f541ad6 req-23b32422-eb1e-4211-9c8c-e8bd55d8a216 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040844 Jul 15 14:10:41.150682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 433/860] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:41.693231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:41.694017 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:41.702322 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:41.703053 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:41.704182 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:41.704658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:41.791251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:41.793087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:41.806483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:41.808735 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:41.809899 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:41.810499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:41.924470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:41.932654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0db130b1-4c72-4963-aafb-5270b1847bd5 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.245389 Jul 15 14:10:41.933246 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 428/861] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:41 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:42.006113 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:42.014535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5c35e10c-4e6c-4d5d-ab92-7f3ae48ad590 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.232224 Jul 15 14:10:42.015434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 434/862] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:41 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:42.497207 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-bddc2947-f172-4c70-be2b-024c81629718 req-d033876c-4292-45ae-bbd8-31716df469a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e731bcda-f71b-4078-ba59-bad8171184f3", "tag": "5c1b0e00-56e7-4f56-8e87-868f14ac3dc5"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:42.507084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-bddc2947-f172-4c70-be2b-024c81629718 req-d033876c-4292-45ae-bbd8-31716df469a7 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:42.507770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-bddc2947-f172-4c70-be2b-024c81629718 req-d033876c-4292-45ae-bbd8-31716df469a7 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:42.520942 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-bddc2947-f172-4c70-be2b-024c81629718 req-d033876c-4292-45ae-bbd8-31716df469a7 service nova] Creating event network-changed:5c1b0e00-56e7-4f56-8e87-868f14ac3dc5 for instance e731bcda-f71b-4078-ba59-bad8171184f3 on hv-cinder-85000 Jul 15 14:10:42.526610 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-bddc2947-f172-4c70-be2b-024c81629718 req-d033876c-4292-45ae-bbd8-31716df469a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033392 Jul 15 14:10:42.527573 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 429/863] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:42.950249 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:42.951035 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:42.958821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:42.959262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:42.960815 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:42.961273 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:43.035450 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:43.037141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:43.053090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:43.054494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:43.058669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:43.059141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:43.164716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:43.174949 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-534e37d8-1566-4163-81c1-abccad48d8ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1577 microversion: 2.1 time: 0.228610 Jul 15 14:10:43.175804 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 435/864] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:42 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:43.241876 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:43.256122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-79bd63b0-643c-4a16-9aa5-3a64cc841376 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.224372 Jul 15 14:10:43.257220 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 430/865] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:43 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:44.199792 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:44.200414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:44.209187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:44.209633 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:44.210401 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:44.210829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:44.275248 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:44.275869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:44.282823 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:44.283271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:44.284051 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:44.284513 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:44.384832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:44.400063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4088b539-a081-455d-a4c9-d96872dc1b05 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1564 microversion: 2.1 time: 0.205012 Jul 15 14:10:44.401535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 436/866] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:44 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:44.460343 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:44.474767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-fc932479-214c-43f3-ac0a-1229c3fbffb7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.204482 Jul 15 14:10:44.475857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 431/867] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:44 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:10:45.492889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:45.493803 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:45.500424 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:45.500892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:45.501687 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:45.502135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:45.636565 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:45.644509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f31ba2e8-5725-45ca-a34d-bd4cc685f9fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.155670 Jul 15 14:10:45.645072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 437/868] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:45 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:46.661385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:46.661998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:46.668639 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:46.669093 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:46.669861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:46.670302 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:46.802882 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:46.810502 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4a4674f8-ed94-4fae-b67e-140244e56acf tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.152973 Jul 15 14:10:46.811064 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 432/869] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:46 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:47.828157 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:47.828840 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:47.835598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:47.836049 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:47.836856 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:47.837301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:47.971732 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:47.979522 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-58e054fe-27b4-49d0-a928-85cf67cd935e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.155150 Jul 15 14:10:47.983328 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 438/870] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:47 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:49.000518 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:49.001342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:49.008986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:49.009563 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:49.010345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:49.010776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:49.175160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:49.183162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b08d3409-cabb-40ed-8411-c1803d2ba486 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.186522 Jul 15 14:10:49.183857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 433/871] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:48 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:49.206071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-cdda2861-01a7-4da6-a039-8949b1bb3a24 req-9e6d340c-e8d0-40c5-826a-86fd05af6119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e731bcda-f71b-4078-ba59-bad8171184f3", "name": "network-vif-plugged", "status": "completed", "tag": "5c1b0e00-56e7-4f56-8e87-868f14ac3dc5"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:49.210820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:49.211738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=10 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:49.218442 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-cdda2861-01a7-4da6-a039-8949b1bb3a24 req-9e6d340c-e8d0-40c5-826a-86fd05af6119 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:49.218893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-cdda2861-01a7-4da6-a039-8949b1bb3a24 req-9e6d340c-e8d0-40c5-826a-86fd05af6119 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:49.231088 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-cdda2861-01a7-4da6-a039-8949b1bb3a24 req-9e6d340c-e8d0-40c5-826a-86fd05af6119 service nova] Creating event network-vif-plugged:5c1b0e00-56e7-4f56-8e87-868f14ac3dc5 for instance e731bcda-f71b-4078-ba59-bad8171184f3 on hv-cinder-85000 Jul 15 14:10:49.236276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-cdda2861-01a7-4da6-a039-8949b1bb3a24 req-9e6d340c-e8d0-40c5-826a-86fd05af6119 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034484 Jul 15 14:10:49.237310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 439/872] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:50.200489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:50.201614 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:50.203097 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:50.209448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:50.209902 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:50.210683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:50.211121 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:50.600378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:50.608497 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3dff3af5-9650-49f0-8844-93e7d0f80941 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1368 microversion: 2.1 time: 0.411874 Jul 15 14:10:50.609083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 434/873] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:50 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:51.627836 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:51.628571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:51.635165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:51.635662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:51.636530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:51.637086 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:51.773703 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:10:51.781515 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3d3e91fb-8dfe-4b74-9a3b-7fd468788e85 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1558 microversion: 2.1 time: 0.159060 Jul 15 14:10:51.782095 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 440/874] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:10:51 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:10:51.797744 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:10:51.798290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:10:51.805058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:51.805541 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:51.806326 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:51.806762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:51.810706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:10:51.894890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7beba43b-dfc7-4c75-80fa-0bf1ce22f0f6 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101140 Jul 15 14:10:51.895480 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 435/875] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jul 15 14:10:51 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:10:52.868584 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-94089de8-37bd-4e4c-ad7f-5b71a3d57649 req-afb0207f-e2c6-4e16-914c-d83f6a73e00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e731bcda-f71b-4078-ba59-bad8171184f3", "tag": "5c1b0e00-56e7-4f56-8e87-868f14ac3dc5"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:10:52.876891 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-94089de8-37bd-4e4c-ad7f-5b71a3d57649 req-afb0207f-e2c6-4e16-914c-d83f6a73e00d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:10:52.878066 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-94089de8-37bd-4e4c-ad7f-5b71a3d57649 req-afb0207f-e2c6-4e16-914c-d83f6a73e00d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:10:52.889290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-94089de8-37bd-4e4c-ad7f-5b71a3d57649 req-afb0207f-e2c6-4e16-914c-d83f6a73e00d service nova] Creating event network-changed:5c1b0e00-56e7-4f56-8e87-868f14ac3dc5 for instance e731bcda-f71b-4078-ba59-bad8171184f3 on hv-cinder-85000 Jul 15 14:10:52.894486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-94089de8-37bd-4e4c-ad7f-5b71a3d57649 req-afb0207f-e2c6-4e16-914c-d83f6a73e00d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030035 Jul 15 14:10:52.895455 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 441/876] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:29.048177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=17 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:29.049091 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:29.053130 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:29.053623 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:29.061160 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:29.061614 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:29.062404 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:29.062840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:29.088501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a82d43c2-fbc0-468a-8190-ae0e3383b2a7 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/ips" status: 200 len: 148 microversion: 2.1 time: 0.041721 Jul 15 14:11:29.089081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 436/877] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jul 15 14:11:29 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:30.464834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "230d6a05-d33a-4b3f-8036-38a13bc801d8"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:11:30.465976 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:30.468216 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=19 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:30.468915 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=68 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:30.476053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:30.476537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:30.477329 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:30.477774 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:30.883061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-708b6d09-6b11-4b7a-96c0-6119f617a56e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "POST /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422528 Jul 15 14:11:30.883678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 442/878] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:11:30 2022] POST /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:38.499797 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:38.500454 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:38.507194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:38.507639 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:38.508414 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:38.508851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:38.661650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lazy-loading 'services' on Instance uuid e731bcda-f71b-4078-ba59-bad8171184f3 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:11:38.758603 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9d64ce60-ce09-4b82-9d66-eb61f6e59c0c tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments/230d6a05-d33a-4b3f-8036-38a13bc801d8" status: 202 len: 0 microversion: 2.1 time: 0.262515 Jul 15 14:11:38.759186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 437/879] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:11:38 2022] DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments/230d6a05-d33a-4b3f-8036-38a13bc801d8 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 14:11:38.772348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:38.773468 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:38.780487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:38.780943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:38.781728 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:38.782223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:38.819685 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6ade4ae7-1dc0-4209-8447-cf71ad4eba4e tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052295 Jul 15 14:11:38.820357 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 443/880] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:11:38 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:39.832356 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:39.833436 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:39.840191 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:39.840746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:39.841521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:39.841961 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:39.870768 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5f13563e-462c-4862-abb7-b75347646673 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043293 Jul 15 14:11:39.871344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 438/881] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jul 15 14:11:39 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 14:11:39.929734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:39.930267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:39.936639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:39.937084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:39.937833 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:39.938264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:39.963062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:11:40.035969 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a268a60d-a9a3-4d8c-9755-1d93172dad2b tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 204 len: 0 microversion: 2.1 time: 0.110546 Jul 15 14:11:40.036601 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 444/882] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:39 2022] DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:11:40.045055 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:40.045770 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:40.051866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.052319 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.053135 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.053575 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.190283 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:40.197889 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9014d40c-8773-4631-8f01-79b41787c98a tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1681 microversion: 2.1 time: 0.156688 Jul 15 14:11:40.198449 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:40 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:40.390726 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:40.391630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:40.398972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.399422 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.400210 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.400679 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.426999 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:11:40.506795 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ea48d13e-bd37-489e-bd00-7068c238642c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 204 len: 0 microversion: 2.1 time: 0.120712 Jul 15 14:11:40.507376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 445/884] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:40 2022] DELETE /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:11:40.515505 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:40.516143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:40.523435 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.523884 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.524694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:40.525128 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:40.659179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:40.667586 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-97884cb7-7940-4cbd-8824-dcaab6993c6f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1577 microversion: 2.1 time: 0.156033 Jul 15 14:11:40.668147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 440/885] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:40 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:41.215664 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:41.216409 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:41.222811 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:41.223260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:41.224020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:41.224488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:41.356194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:41.363919 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-31a995af-1433-4726-8f66-3b9e6d0eaac8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1681 microversion: 2.1 time: 0.152516 Jul 15 14:11:41.364497 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 446/886] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:41 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:41.686086 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:41.686709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:41.693456 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:41.693905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:41.694680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:41.695116 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:41.844998 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:41.853532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-92bb3465-e025-4ee5-8c15-558bf81e89fc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1577 microversion: 2.1 time: 0.172308 Jul 15 14:11:41.854112 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 441/887] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:41 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:42.382657 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:42.383353 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:42.389925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:42.390380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:42.391155 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:42.391630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:42.523587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:42.531054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0e9abf3d-ede4-44b2-a4b1-d970ce9a2115 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1681 microversion: 2.1 time: 0.152809 Jul 15 14:11:42.531628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 447/888] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:42 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:42.871262 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:42.871879 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:42.878485 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:42.878940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:42.879709 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:42.880144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:43.019466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:43.027410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7cbe65ed-d04e-4337-a481-8bf661b764e2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1577 microversion: 2.1 time: 0.159974 Jul 15 14:11:43.028409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 442/889] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:42 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:43.548197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:43.548837 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:43.555235 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:43.555721 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:43.556537 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:43.556979 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:43.688265 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:43.695680 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f019afff-fde0-43f8-9d3c-aa6399bcf4d8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1681 microversion: 2.1 time: 0.151392 Jul 15 14:11:43.696627 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 448/890] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:43 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:44.045122 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:44.045844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:44.052623 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.053149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.053928 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.054370 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.203143 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:44.210819 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-a2a50bd1-f506-4f61-81af-b5a2beb31a47 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1577 microversion: 2.1 time: 0.169647 Jul 15 14:11:44.211383 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 443/891] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:44 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:44.605748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-86a436df-d253-4c7a-acce-8e7eb95f8bb6 req-dec16c5e-5cc5-44aa-b285-488155a0d9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e731bcda-f71b-4078-ba59-bad8171184f3", "name": "network-vif-deleted", "tag": "5c1b0e00-56e7-4f56-8e87-868f14ac3dc5"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:11:44.619250 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-86a436df-d253-4c7a-acce-8e7eb95f8bb6 req-dec16c5e-5cc5-44aa-b285-488155a0d9b3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.619853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-86a436df-d253-4c7a-acce-8e7eb95f8bb6 req-dec16c5e-5cc5-44aa-b285-488155a0d9b3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.641463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-86a436df-d253-4c7a-acce-8e7eb95f8bb6 req-dec16c5e-5cc5-44aa-b285-488155a0d9b3 service nova] Creating event network-vif-deleted:5c1b0e00-56e7-4f56-8e87-868f14ac3dc5 for instance e731bcda-f71b-4078-ba59-bad8171184f3 on hv-cinder-85000 Jul 15 14:11:44.650313 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-86a436df-d253-4c7a-acce-8e7eb95f8bb6 req-dec16c5e-5cc5-44aa-b285-488155a0d9b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046191 Jul 15 14:11:44.651105 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 449/892] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:44.720261 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:44.720931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:44.730685 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.731288 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.733779 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.734581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.781174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:44.781901 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:44.782516 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lazy-loading 'fault' on Instance uuid e731bcda-f71b-4078-ba59-bad8171184f3 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:11:44.836780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3a211465a0478994d011f89eaf972f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26daacf03c844ff8a7546dfe3b36d8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:44.846528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-85ac1cd8-334a-430e-b796-33247bb9c3fd tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 200 len: 1332 microversion: 2.1 time: 0.136408 Jul 15 14:11:44.857675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 444/893] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:44 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:45.229107 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:45.230274 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:45.239226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:45.240011 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:45.241230 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:45.241887 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:45.320632 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:45.329593 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a8d05e6b-bdf4-4b3d-9b08-532aa0aa6e3c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 200 len: 1225 microversion: 2.1 time: 0.105729 Jul 15 14:11:45.343379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 450/894] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:45 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:11:45.867342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:45.869217 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:45.876850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:45.877333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:45.878424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:45.878873 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:45.907165 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 HTTP/1.1 Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:45.909444 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:45.911227 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'e731bcda-f71b-4078-ba59-bad8171184f3'} Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:45.912162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:45.913669 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:45.914895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:45.914895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4575abd6-5b08-4736-b182-38900f7c3ffa tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 404 len: 111 microversion: 2.1 time: 0.049396 Jul 15 14:11:45.914895 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 445/895] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:45 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:45.920376 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b9bd3686-f9d3-40ef-a4d3-27fddfdc38f8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '.version_select at 0x7fa0c10d6790>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:45.943817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b9bd3686-f9d3-40ef-a4d3-27fddfdc38f8 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011301810" status: 202 len: 0 microversion: 2.1 time: 0.026744 Jul 15 14:11:45.944636 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 451/896] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jul 15 14:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011301810 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:11:46.350835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:46.351520 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:46.357693 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:46.358149 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:46.358926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:46.359372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:46.374300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] HTTP exception thrown: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Request method failure captured: Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf HTTP/1.1 Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XT95ACeQo2DBxYWmEV6AdXAbZ55vKKzsQE31eAHXQvnLEu6iqYcd1EAkTJOppfM-ehKvYrwBDm8LmvyCEC_sy7wjK69xPv1dMXZHS11jrjCuOccpb8GMVWCNE70lkOxqTMaSDe_yiTgDGuxChClWEjBsc6URhinpOR6aOVuel1B0zk Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:46.375862 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddbd6e1cb0814523b4e528c14d06cdad"}]}] Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 1e956289b0e64cc892d453f427845d71 Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:11:46.377554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '8235719c-04b4-4277-8340-90cfffc0c9bf'} Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:46.378837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:11:46.380418 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:46.383746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Returning 404 to user: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:46.383746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-86382092-ebea-4ffd-aa9a-b677ba5638f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 404 len: 111 microversion: 2.1 time: 0.031055 Jul 15 14:11:46.383746 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 446/897] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:46 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:46.427587 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2059735324", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786946882", "security_groups": [{"name": "tempest-secgroup-smoke-245232798"}], "block_device_mapping_v2": [{"uuid": "24207ddd-c94d-4ecf-bb7f-b4e4e7ccb88e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "83416a30-2d17-494b-808c-bdf0235bc309"}]}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:11:46.630928 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] validate_networks() for [('83416a30-2d17-494b-808c-bdf0235bc309', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:11:46.695427 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-3427b74e-c4c1-4e63-b171-86d4d1683253 req-8d5401fe-65c4-474f-aaba-03502dc84077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8235719c-04b4-4277-8340-90cfffc0c9bf", "name": "network-vif-deleted", "tag": "a779e437-fe42-45e9-8ed5-72bfececf241"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:11:46.704602 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3427b74e-c4c1-4e63-b171-86d4d1683253 req-8d5401fe-65c4-474f-aaba-03502dc84077 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:46.705048 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-3427b74e-c4c1-4e63-b171-86d4d1683253 req-8d5401fe-65c4-474f-aaba-03502dc84077 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:46.716932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-3427b74e-c4c1-4e63-b171-86d4d1683253 req-8d5401fe-65c4-474f-aaba-03502dc84077 service nova] Creating event network-vif-deleted:a779e437-fe42-45e9-8ed5-72bfececf241 for instance 8235719c-04b4-4277-8340-90cfffc0c9bf on hv-cinder-85000 Jul 15 14:11:46.721771 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-3427b74e-c4c1-4e63-b171-86d4d1683253 req-8d5401fe-65c4-474f-aaba-03502dc84077 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jul 15 14:11:46.722381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 447/898] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:47.042052 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:11:47.042588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:11:47.042933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:11:47.043337 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:11:47.043743 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:11:47.052649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.053098 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.053892 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.054327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.071543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:11:47.075579 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for user 1e956289b0e64cc892d453f427845d71 and project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:11:47.134935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:11:47.137131 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24207ddd-c94d-4ecf-bb7f-b4e4e7ccb88e',volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:11:47.279613 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d863e170-8c35-4872-98aa-4e7b48f4c802 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855832 Jul 15 14:11:47.280293 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 452/899] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:11:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:11:47.291803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-2b396fcd-80b0-4d5f-a818-dcbfcfedc201 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:47.293297 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-2b396fcd-80b0-4d5f-a818-dcbfcfedc201 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:47.360236 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-2b396fcd-80b0-4d5f-a818-dcbfcfedc201 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:47.369490 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-2b396fcd-80b0-4d5f-a818-dcbfcfedc201 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1094 microversion: 2.1 time: 0.082608 Jul 15 14:11:47.370303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 448/900] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:47 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:47.832797 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:47.833285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:47.839986 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.840520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.841266 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.841674 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.856297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 HTTP/1.1 Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:11:47.858001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.859682 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'e731bcda-f71b-4078-ba59-bad8171184f3'} Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:47.860638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.861922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.863486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:47.863486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-825e03e9-5801-4cbc-9a18-7d8509db07f3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 404 len: 111 microversion: 2.1 time: 0.030676 Jul 15 14:11:47.863486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 453/901] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:47 2022] DELETE /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:47.869430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:47.870084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e731bcda-f71b-4078-ba59-bad8171184f3] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:47.876851 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.877308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.878083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:47.878525 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:47.892457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 HTTP/1.1 Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:47.894285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.896650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'e731bcda-f71b-4078-ba59-bad8171184f3'} Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:47.900546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. Jul 15 14:11:47.902145 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:47.903583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e731bcda-f71b-4078-ba59-bad8171184f3 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:47.903583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-635a75c4-3202-4efd-a902-f29c274f3fb9 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jul 15 14:11:47.903583 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 449/902] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:47 2022] GET /compute/v2.1/servers/e731bcda-f71b-4078-ba59-bad8171184f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:48.392268 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:48.394853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:48.407562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:48.408367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:48.409834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:48.410662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:48.493595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:48.501958 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-d41023a1-f0fe-4162-8660-e49dec8f7bbe tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1210 microversion: 2.1 time: 0.117134 Jul 15 14:11:48.502550 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 454/903] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:48 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:49.035694 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:49.036249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:49.043631 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.044070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.044867 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.045298 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.059453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c HTTP/1.1 Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:49.060972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.062409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'e7c4ebb6-f959-401d-b3f8-66ee92d1a98c'} Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:49.063221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.064555 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.065861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:49.065861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-3beab8e0-9cb7-42dc-8c23-60d1036036cb tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 404 len: 111 microversion: 2.1 time: 0.030468 Jul 15 14:11:49.065861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 450/904] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:49 2022] DELETE /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:11:49.070975 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:49.071577 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: e7c4ebb6-f959-401d-b3f8-66ee92d1a98c] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:49.077533 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.077978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.078738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.079169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.092454 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c HTTP/1.1 Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:11:49.094024 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.095716 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'e7c4ebb6-f959-401d-b3f8-66ee92d1a98c'} Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:49.096551 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. Jul 15 14:11:49.098354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.100933 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance e7c4ebb6-f959-401d-b3f8-66ee92d1a98c could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:49.101774 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-dd0791c6-7fa1-4ad9-9e2f-0aa01a4ce7e3 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c" status: 404 len: 111 microversion: 2.1 time: 0.034663 Jul 15 14:11:49.102857 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 455/905] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:49 2022] GET /compute/v2.1/servers/e7c4ebb6-f959-401d-b3f8-66ee92d1a98c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:49.111074 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:49.111576 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:49.118608 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.119063 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.119839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.120280 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.141264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc HTTP/1.1 Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:49.142856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.144212 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': 'f7b75964-be8c-4cda-b4da-d9156a8b65fc'} Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:49.145052 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.146296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.147622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:49.147622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-10bd11db-d2f0-4960-bd82-63a6efd7fc3f tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 404 len: 111 microversion: 2.1 time: 0.037503 Jul 15 14:11:49.147622 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 451/906] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:49 2022] DELETE /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:49.157922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:49.158790 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: f7b75964-be8c-4cda-b4da-d9156a8b65fc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:49.165737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.166184 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.166957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.167496 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.189360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc HTTP/1.1 Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:11:49.190978 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.192639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'f7b75964-be8c-4cda-b4da-d9156a8b65fc'} Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:49.193461 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. Jul 15 14:11:49.195177 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:49.197053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance f7b75964-be8c-4cda-b4da-d9156a8b65fc could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:49.197053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4e501845-8ec6-4efb-a304-30408879bea0 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc" status: 404 len: 111 microversion: 2.1 time: 0.043278 Jul 15 14:11:49.197053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 456/907] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:49 2022] GET /compute/v2.1/servers/f7b75964-be8c-4cda-b4da-d9156a8b65fc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:49.519110 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:49.519618 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:49.526367 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.527023 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.527784 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:49.528223 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:49.671137 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:49.679424 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e43e7101-e160-4610-a8f8-07f997dd58d2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.164171 Jul 15 14:11:49.680104 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 452/908] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:49 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:50.110640 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-be0cdb56-18d1-4f2c-a14a-13f95393780f req-2a82c624-5756-4a77-9837-643d959ebf6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ea0b24-ed6f-48ea-a44f-3560c297855d", "tag": "045827b2-1b07-4c35-8cc7-f2329ad46ed0"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:11:50.119385 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-be0cdb56-18d1-4f2c-a14a-13f95393780f req-2a82c624-5756-4a77-9837-643d959ebf6a service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.119832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-be0cdb56-18d1-4f2c-a14a-13f95393780f req-2a82c624-5756-4a77-9837-643d959ebf6a service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.131994 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-be0cdb56-18d1-4f2c-a14a-13f95393780f req-2a82c624-5756-4a77-9837-643d959ebf6a service nova] Creating event network-changed:045827b2-1b07-4c35-8cc7-f2329ad46ed0 for instance f9ea0b24-ed6f-48ea-a44f-3560c297855d on hv-cinder-85000 Jul 15 14:11:50.137765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-be0cdb56-18d1-4f2c-a14a-13f95393780f req-2a82c624-5756-4a77-9837-643d959ebf6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115104 Jul 15 14:11:50.138671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 457/909] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:11:50.342292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:50.342849 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:50.349937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.350390 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.351203 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.351638 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.367120 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc HTTP/1.1 Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:11:50.368812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.370245 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '5f8b8d9e-553e-4193-aaf6-1f599d5282bc'} Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:50.374161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.375494 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.377845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:50.377845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-192e63ea-15b8-48c4-90e3-a88fb178c506 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 404 len: 111 microversion: 2.1 time: 0.032586 Jul 15 14:11:50.377845 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 453/910] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:11:50 2022] DELETE /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:11:50.380143 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:50.381499 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] [instance: 5f8b8d9e-553e-4193-aaf6-1f599d5282bc] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:50.387802 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.388256 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.389061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.389510 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.404616 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] HTTP exception thrown: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Request method failure captured: Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc HTTP/1.1 Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XScV5-XK3G4v-TvzYJMXkvyENCKRLtriSi5e2L7qHYRPt5bu6bOGIBPZCT9ukFU4wCQax605q_tPk7I0CoRpzB9g3nSD7vp5CJm12aSVozAbJdfNu1pkdelt6VFaJ5PhvzD4cfbbWrtRtcWvSTQ5b31zfNa8wDxO-DgkjVrM9kLe_g Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:11:50.406272 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26daacf03c844ff8a7546dfe3b36d8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26daacf03c844ff8a7546dfe3b36d8bb"}]}] Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 26daacf03c844ff8a7546dfe3b36d8bb Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110201535 Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 4a3a211465a0478994d011f89eaf972f Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-AttachVolumeNegativeTest-2110201535-project Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.407668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '5f8b8d9e-553e-4193-aaf6-1f599d5282bc'} Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:11:50.408490 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. Jul 15 14:11:50.410405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:11:50.412870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] Returning 404 to user: Instance 5f8b8d9e-553e-4193-aaf6-1f599d5282bc could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:11:50.412870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-eaf722a1-b428-4857-836d-e8adff3b4713 tempest-AttachVolumeNegativeTest-2110201535 tempest-AttachVolumeNegativeTest-2110201535-project] 10.222.0.16 "GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc" status: 404 len: 111 microversion: 2.1 time: 0.032536 Jul 15 14:11:50.412870 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 458/911] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:50 2022] GET /compute/v2.1/servers/5f8b8d9e-553e-4193-aaf6-1f599d5282bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 14:11:50.696318 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:50.696987 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:50.703085 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.703540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.704310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:50.704805 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:50.960812 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:50.968533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-53bc33ed-0b7f-49cd-aa8b-b1a950debacd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.275960 Jul 15 14:11:50.978604 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 454/912] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:50 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:51.985829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:51.986524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:51.994338 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:51.994817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:51.995622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:51.996084 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:52.174339 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:52.396719 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:52.406178 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-037ba300-f990-4979-8290-b0a7047e74f7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.424537 Jul 15 14:11:52.408124 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 459/913] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:51 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:53.433229 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:53.433853 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:53.440753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:53.441208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:53.441995 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:53.442432 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:53.591132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:53.605174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ae963c02-ba67-4d40-9e2f-3fbae8d8ec68 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.184537 Jul 15 14:11:53.606044 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 455/914] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:53 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:54.628853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:54.629470 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:54.636232 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:54.636704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:54.637462 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:54.637893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:54.775400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:54.783629 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a5a20fdb-15f0-4645-81f4-0a0544bdd512 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.158626 Jul 15 14:11:54.784240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 460/915] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:54 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:55.801153 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:55.801757 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:55.810324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:55.810776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:55.811561 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:55.811995 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:55.944162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:55.951874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9bdfadb0-488a-48fc-842c-dcac13129520 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.154600 Jul 15 14:11:55.952459 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 456/916] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:55 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:56.969141 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:56.969736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:56.976295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:56.976793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:56.977546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:56.977985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:57.061827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:57.082173 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:57.127562 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:57.137347 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-dcdb8231-69bf-4b37-a818-c1302fa6965e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.172156 Jul 15 14:11:57.137907 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 461/917] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:56 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:58.153934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:58.154552 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:58.157004 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:58.162238 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:58.162683 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:58.163466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:58.163905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:58.184312 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:11:58.305888 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:58.313412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-18b6cf3e-b1d5-48a5-883f-29010e8d9550 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.163542 Jul 15 14:11:58.313968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 457/918] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:58 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:11:59.332738 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:11:59.333379 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:11:59.339984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:59.340487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:59.341231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:11:59.341676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:11:59.487963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:11:59.497067 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-17dab3e1-c2c2-40a5-abd0-dda83d910d03 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.169570 Jul 15 14:11:59.497785 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 462/919] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:11:59 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:00.517948 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:00.518560 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:00.522005 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=49 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:00.528922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:00.529550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:00.531030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:00.531456 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:00.690059 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:00.700049 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8f94d739-8e5c-45be-8753-15ddf8f19361 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.186672 Jul 15 14:12:00.705913 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 458/920] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:00 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:01.022591 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:01.023520 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:01.028337 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-62661f33-945c-4263-b8d8-aa3024ddf266 req-f6c0fe15-1971-4789-bf93-6c5b075e7c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:01.034925 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:01.037730 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-62661f33-945c-4263-b8d8-aa3024ddf266 req-f6c0fe15-1971-4789-bf93-6c5b075e7c4c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.038577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-62661f33-945c-4263-b8d8-aa3024ddf266 req-f6c0fe15-1971-4789-bf93-6c5b075e7c4c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.041965 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.042423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.043204 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.043644 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.051254 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-62661f33-945c-4263-b8d8-aa3024ddf266 req-f6c0fe15-1971-4789-bf93-6c5b075e7c4c service nova] Creating event network-changed:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:12:01.057180 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-62661f33-945c-4263-b8d8-aa3024ddf266 req-f6c0fe15-1971-4789-bf93-6c5b075e7c4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032319 Jul 15 14:12:01.058103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 459/921] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:01.072931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:12:01.162880 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-91c3b840-4f68-4a3c-a85b-034add8edf06 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 204 len: 0 microversion: 2.1 time: 0.143218 Jul 15 14:12:01.163812 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 463/922] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:12:01 2022] DELETE /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:12:01.173457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:01.174158 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:01.181467 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.182209 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.183144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.183767 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.323440 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:01.330968 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ee99d06f-8616-4d88-bc03-5b3c94a406ea tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.162751 Jul 15 14:12:01.331540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 460/923] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:01 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:01.717835 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:01.718547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:01.725277 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.725734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.726514 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:01.726951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:01.875340 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:01.888496 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-77d5158d-6d23-4495-9934-1e06783552a2 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.174898 Jul 15 14:12:01.889526 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 464/924] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:01 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:02.348200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:02.348957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:02.355306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-5eb19b98-b217-4049-83e9-b62c35951d71 req-e7666ec2-4012-45b3-9a23-34f8f3470c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ea0b24-ed6f-48ea-a44f-3560c297855d", "name": "network-vif-plugged", "status": "completed", "tag": "045827b2-1b07-4c35-8cc7-f2329ad46ed0"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:02.355983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:02.356346 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:02.357165 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:02.357612 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:02.365456 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5eb19b98-b217-4049-83e9-b62c35951d71 req-e7666ec2-4012-45b3-9a23-34f8f3470c9e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:02.365904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-5eb19b98-b217-4049-83e9-b62c35951d71 req-e7666ec2-4012-45b3-9a23-34f8f3470c9e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:02.378199 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-5eb19b98-b217-4049-83e9-b62c35951d71 req-e7666ec2-4012-45b3-9a23-34f8f3470c9e service nova] Creating event network-vif-plugged:045827b2-1b07-4c35-8cc7-f2329ad46ed0 for instance f9ea0b24-ed6f-48ea-a44f-3560c297855d on hv-cinder-85000 Jul 15 14:12:02.383756 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-5eb19b98-b217-4049-83e9-b62c35951d71 req-e7666ec2-4012-45b3-9a23-34f8f3470c9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162567 Jul 15 14:12:02.384336 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 461/925] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:02.495064 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:02.502617 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b5e34764-1188-4f5b-99ad-ae134c7634a9 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.158239 Jul 15 14:12:02.503180 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 465/926] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:02 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:02.914252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:02.914945 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:02.921123 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:02.921565 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:02.922321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:02.922752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:03.063240 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:03.070874 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-4029baa8-a666-4afd-9c1e-592b150c1af8 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.161370 Jul 15 14:12:03.071437 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:02 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:03.522618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:03.523171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:03.529580 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:03.530023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:03.530771 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:03.531200 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:03.664535 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:03.672204 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a4a0a261-9d6c-4e1b-80ab-985d1d4d1437 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.154165 Jul 15 14:12:03.672806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 466/928] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:03 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:04.087837 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:04.088379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:04.095925 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:04.096369 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:04.097218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:04.097651 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:04.234170 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:04.243320 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-15d20c98-59e4-4fba-8669-1a18da473baa tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.159400 Jul 15 14:12:04.243899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:04 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:04.690094 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:04.690755 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:04.697507 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:04.697968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:04.698748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:04.699186 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:04.842991 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:04.850676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-a59acee2-5367-47f8-abf0-00c67fe6e1d7 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.164454 Jul 15 14:12:04.851259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 467/930] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:04 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:05.260321 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:05.260923 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:05.267489 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:05.267970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:05.268849 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:05.269292 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:05.403252 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:05.410951 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6ae2461e-df7d-43ad-8f32-52065e8f0a4b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.155173 Jul 15 14:12:05.411509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 464/931] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:05 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:05.870119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:05.870691 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:05.877737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:05.878190 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:05.878971 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:05.879409 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:06.016736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:06.025901 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-8b7ab9a3-fdb0-4b11-9b3c-8537225a230f tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1570 microversion: 2.1 time: 0.159782 Jul 15 14:12:06.026492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 468/932] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:05 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:06.427243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:06.428012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:06.434778 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:06.435230 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:06.436233 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:06.436706 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:06.639556 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:06.647535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6a5662a9-9dfa-4b18-93c7-a04d85e17f21 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1265 microversion: 2.1 time: 0.224204 Jul 15 14:12:06.648200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:06 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:06.900997 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-ed9af217-dddd-49ec-8b71-3bf567fda2bf req-18658b56-7c6b-4b14-9076-a61a6e5f4532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a999d1e-a17a-4ea9-8f71-3a981b55733b", "name": "network-vif-deleted", "tag": "672e43eb-ef9b-49b3-9a76-4d3b2227aa67"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:06.911498 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ed9af217-dddd-49ec-8b71-3bf567fda2bf req-18658b56-7c6b-4b14-9076-a61a6e5f4532 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:06.912040 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ed9af217-dddd-49ec-8b71-3bf567fda2bf req-18658b56-7c6b-4b14-9076-a61a6e5f4532 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:06.924302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-ed9af217-dddd-49ec-8b71-3bf567fda2bf req-18658b56-7c6b-4b14-9076-a61a6e5f4532 service nova] Creating event network-vif-deleted:672e43eb-ef9b-49b3-9a76-4d3b2227aa67 for instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b on hv-cinder-85000 Jul 15 14:12:06.930762 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-ed9af217-dddd-49ec-8b71-3bf567fda2bf req-18658b56-7c6b-4b14-9076-a61a6e5f4532 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034562 Jul 15 14:12:06.931434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 469/934] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:07.043764 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:07.044271 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:07.050643 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.051100 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:07.051893 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.052329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:07.132022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72d7744f4c4493a8e2a5f87e9a89d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e608cc75a5ed4f05b462c84c29a31788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:07.142348 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-de26749a-5e8b-4d9d-929b-2a6fe2743422 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 200 len: 1220 microversion: 2.1 time: 0.102311 Jul 15 14:12:07.156014 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 466/935] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:07 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:07.665467 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:07.666375 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:07.672988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.673436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:07.674212 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.674653 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:07.854256 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:07.864693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-432c24f5-bbd8-4b55-83ce-9a6931743236 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1452 microversion: 2.1 time: 0.203552 Jul 15 14:12:07.865364 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:07 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:07.882141 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:07.882822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:07.889967 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.890425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:07.891231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:07.891791 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:08.059871 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:08.074253 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1016211f-262e-468c-a591-ec3d82f5ef77 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1452 microversion: 2.1 time: 0.196268 Jul 15 14:12:08.075288 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 467/937] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:07 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1452 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:08.166863 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:08.167509 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] [instance: 1a999d1e-a17a-4ea9-8f71-3a981b55733b] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:08.173696 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:08.174150 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:08.174929 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:08.175371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:08.189816 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] HTTP exception thrown: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Request method failure captured: Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b HTTP/1.1 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XSgTvLR8rN3SL0LSmnrqBr_Q3X3dNrjLJJwky2A8NuWJJ7CkyuSsyJk8iFtosu-_MnqaXQE7qveqSuVXBt4Pee8T59KMylEktL69TJgxtqIFRkn-0PeGZN8SZ4RREYfTc3phDiz4iHtT054BO5aM2F7mpZ35iBD4cdNtRN8lAPq-P4 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: e608cc75a5ed4f05b462c84c29a31788 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestShelveInstance-1169159282 Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:12:08.191487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e608cc75a5ed4f05b462c84c29a31788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e608cc75a5ed4f05b462c84c29a31788"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e608cc75a5ed4f05b462c84c29a31788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e608cc75a5ed4f05b462c84c29a31788"}]}] Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestShelveInstance-1169159282 Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: e608cc75a5ed4f05b462c84c29a31788 Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestShelveInstance-1169159282 Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestShelveInstance-1169159282-project Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: f72d7744f4c4493a8e2a5f87e9a89d5c Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestShelveInstance-1169159282-project Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. Jul 15 14:12:08.193327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '1a999d1e-a17a-4ea9-8f71-3a981b55733b'} Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:12:08.194852 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. Jul 15 14:12:08.196581 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:08.198867 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Returning 404 to user: Instance 1a999d1e-a17a-4ea9-8f71-3a981b55733b could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:12:08.199734 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7b05cbbb-c1a2-4c49-9e14-848ed11f1da3 tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b" status: 404 len: 111 microversion: 2.1 time: 0.037539 Jul 15 14:12:08.200571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 471/938] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:08 2022] GET /compute/v2.1/servers/1a999d1e-a17a-4ea9-8f71-3a981b55733b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:12:08.386865 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7f6689eb-68f9-43f1-ac33-177ceb7c88bd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] Calling method '.version_select at 0x7fa0c101b280>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:08.418419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7f6689eb-68f9-43f1-ac33-177ceb7c88bd tempest-TestShelveInstance-1169159282 tempest-TestShelveInstance-1169159282-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1851351781" status: 202 len: 0 microversion: 2.1 time: 0.038548 Jul 15 14:12:08.420324 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 468/939] 10.222.0.16 () {58 vars in 1253 bytes} [Fri Jul 15 14:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1851351781 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:12:09.920335 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-3b6dbb94-7d4b-4cf3-8927-4966f31e3597 req-65fe9b52-8b81-4233-8305-ced9246aaac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ea0b24-ed6f-48ea-a44f-3560c297855d", "tag": "045827b2-1b07-4c35-8cc7-f2329ad46ed0"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:09.931417 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-3b6dbb94-7d4b-4cf3-8927-4966f31e3597 req-65fe9b52-8b81-4233-8305-ced9246aaac1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:09.931829 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-3b6dbb94-7d4b-4cf3-8927-4966f31e3597 req-65fe9b52-8b81-4233-8305-ced9246aaac1 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:09.945087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-3b6dbb94-7d4b-4cf3-8927-4966f31e3597 req-65fe9b52-8b81-4233-8305-ced9246aaac1 service nova] Creating event network-changed:045827b2-1b07-4c35-8cc7-f2329ad46ed0 for instance f9ea0b24-ed6f-48ea-a44f-3560c297855d on hv-cinder-85000 Jul 15 14:12:09.950261 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-3b6dbb94-7d4b-4cf3-8927-4966f31e3597 req-65fe9b52-8b81-4233-8305-ced9246aaac1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035869 Jul 15 14:12:09.951056 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 472/940] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:19.721493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=54 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:19.722426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:19.727496 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-720149691", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "networks": [{"uuid": "9d7449fa-4c1b-47af-88d2-83c6bf0d6c8a"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:19.785515 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] validate_networks() for [('9d7449fa-4c1b-47af-88d2-83c6bf0d6c8a', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:12:20.161582 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:12:20.162028 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:12:20.162495 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:12:20.163031 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:12:20.163295 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:12:20.172594 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:20.173132 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:20.174175 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:20.174646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:20.192546 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Getting quotas for project 18d5cd47ac9f408385f194b94f17049b. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:12:20.197511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Getting quotas for user 9c0337148d584c14a3dc0fc7ccff766b and project 18d5cd47ac9f408385f194b94f17049b. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:12:20.208696 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:12:20.210944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:12:20.257922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-ae128407-eacc-43c0-a3f8-9222b35ef65a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537844 Jul 15 14:12:20.258573 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 469/941] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:12:20.269630 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0ee7a711-e279-41f0-9215-fea3d27837b3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:20.270469 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0ee7a711-e279-41f0-9215-fea3d27837b3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:20.273260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:20.273922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:20.334423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0ee7a711-e279-41f0-9215-fea3d27837b3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:20.341358 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0ee7a711-e279-41f0-9215-fea3d27837b3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1213 microversion: 2.1 time: 0.076315 Jul 15 14:12:20.342056 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 473/942] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:20 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:21.360202 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:21.360932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:21.368928 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:21.369375 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:21.370157 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:21.370594 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:21.465306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:21.474804 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d15b7c95-e002-495f-8db9-cf5da609431d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1271 microversion: 2.1 time: 0.119830 Jul 15 14:12:21.475339 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 470/943] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:21 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:22.492784 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:22.493400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:22.500336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:22.501080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:22.501868 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:22.502311 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:22.638551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-25047fd5-931b-41b5-8bb9-949662c561ea req-7a1deadb-3cc8-42a2-9033-5718bfa1693c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a74aad-ee47-42fd-9d8d-889841825a26", "tag": "ce276f51-b426-4700-9cbd-9173e17fc028"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:22.659534 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:22.660315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-25047fd5-931b-41b5-8bb9-949662c561ea req-7a1deadb-3cc8-42a2-9033-5718bfa1693c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:22.661147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-25047fd5-931b-41b5-8bb9-949662c561ea req-7a1deadb-3cc8-42a2-9033-5718bfa1693c service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:22.673700 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-25047fd5-931b-41b5-8bb9-949662c561ea req-7a1deadb-3cc8-42a2-9033-5718bfa1693c service nova] Creating event network-changed:ce276f51-b426-4700-9cbd-9173e17fc028 for instance 97a74aad-ee47-42fd-9d8d-889841825a26 on hv-cinder-85000 Jul 15 14:12:22.673983 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-279bf60a-0e8b-46d8-b795-63c293b772cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.184997 Jul 15 14:12:22.675000 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 474/944] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:22 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:22.679484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-25047fd5-931b-41b5-8bb9-949662c561ea req-7a1deadb-3cc8-42a2-9033-5718bfa1693c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053022 Jul 15 14:12:22.680080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 471/945] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:23.691431 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:23.692036 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:23.714815 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:23.715262 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:23.716048 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:23.716512 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:23.886443 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:23.894127 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-c811aa5a-626c-43a1-9d01-ce21998874d2 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.206803 Jul 15 14:12:23.894695 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 475/946] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:23 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:24.912409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:24.913129 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:24.919718 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:24.920162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:24.920979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:24.921412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:25.068678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:25.076446 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7e714f3b-6644-41dd-ac2e-b5c5e4f85031 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.169461 Jul 15 14:12:25.077015 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 472/947] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:24 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:26.099264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:26.100243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:26.108042 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:26.108511 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:26.109324 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:26.109798 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:26.268459 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:26.278134 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ff927e37-1a1d-49b4-9b8a-1a6494df968e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.185062 Jul 15 14:12:26.278731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 476/948] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:26 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:27.296243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:27.296846 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:27.303946 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:27.304415 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:27.305362 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:27.305807 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:27.458977 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:27.469081 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-99a7b24e-cdb3-4e07-966e-971eb1ac6d5b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.176909 Jul 15 14:12:27.470332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 473/949] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:27 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:27.716421 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-93bc74ce-5cf6-4595-9c5e-02022101d3ed req-c59eff69-0f6c-41af-8494-c4bc67c5991e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a74aad-ee47-42fd-9d8d-889841825a26", "name": "network-vif-plugged", "status": "completed", "tag": "ce276f51-b426-4700-9cbd-9173e17fc028"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:27.726159 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-93bc74ce-5cf6-4595-9c5e-02022101d3ed req-c59eff69-0f6c-41af-8494-c4bc67c5991e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:27.726683 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-93bc74ce-5cf6-4595-9c5e-02022101d3ed req-c59eff69-0f6c-41af-8494-c4bc67c5991e service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:27.739112 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-93bc74ce-5cf6-4595-9c5e-02022101d3ed req-c59eff69-0f6c-41af-8494-c4bc67c5991e service nova] Creating event network-vif-plugged:ce276f51-b426-4700-9cbd-9173e17fc028 for instance 97a74aad-ee47-42fd-9d8d-889841825a26 on hv-cinder-85000 Jul 15 14:12:27.749140 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-93bc74ce-5cf6-4595-9c5e-02022101d3ed req-c59eff69-0f6c-41af-8494-c4bc67c5991e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035659 Jul 15 14:12:27.749727 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 477/950] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:28.486823 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:28.487391 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:28.494449 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:28.494898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:28.495685 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:28.496200 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:28.638045 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:28.651695 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c6dc9f5e-9b91-4132-84a1-14b59d73dbb5 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1313 microversion: 2.1 time: 0.168569 Jul 15 14:12:28.652751 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 474/951] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:28 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:29.670488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:29.671195 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:29.678426 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:29.678877 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:29.679665 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:29.680104 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:29.820338 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:29.828151 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3646032e-be41-492a-84a7-65c2eaa27733 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1498 microversion: 2.1 time: 0.162909 Jul 15 14:12:29.828786 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 478/952] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:29 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:30.240670 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:30.241208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:30.243793 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:30.244308 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=6 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:30.251061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:30.251521 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:30.252305 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:30.252773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:30.281983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:12:30.364662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bbfffa2d-0bc8-41d0-9268-a64bd601e605 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 204 len: 0 microversion: 2.1 time: 0.127721 Jul 15 14:12:30.365341 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 475/953] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:12:30 2022] DELETE /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:12:30.373884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:30.374492 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:30.376554 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:30.382489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:30.382943 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:30.383724 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:30.384163 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:30.525701 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:30.533264 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-5f34be75-f996-405a-820b-b3718cfab2cd tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1504 microversion: 2.1 time: 0.163292 Jul 15 14:12:30.533828 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 479/954] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:30 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:31.551167 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:31.551869 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:31.558754 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:31.559207 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:31.559982 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:31.560441 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:31.717231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:31.725619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5954d41a-23e2-4c63-b85c-c5457754d7e3 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1504 microversion: 2.1 time: 0.178645 Jul 15 14:12:31.726201 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 476/955] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:31 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:32.339820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-26790e5a-3483-438c-976e-843d9b9d8520 req-c732fa78-318a-484a-8ffa-8ea4cdac2c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a74aad-ee47-42fd-9d8d-889841825a26", "name": "network-vif-deleted", "tag": "ce276f51-b426-4700-9cbd-9173e17fc028"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:32.352015 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-26790e5a-3483-438c-976e-843d9b9d8520 req-c732fa78-318a-484a-8ffa-8ea4cdac2c2f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:32.352555 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-26790e5a-3483-438c-976e-843d9b9d8520 req-c732fa78-318a-484a-8ffa-8ea4cdac2c2f service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:32.367110 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-26790e5a-3483-438c-976e-843d9b9d8520 req-c732fa78-318a-484a-8ffa-8ea4cdac2c2f service nova] Creating event network-vif-deleted:ce276f51-b426-4700-9cbd-9173e17fc028 for instance 97a74aad-ee47-42fd-9d8d-889841825a26 on hv-cinder-85000 Jul 15 14:12:32.372838 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-26790e5a-3483-438c-976e-843d9b9d8520 req-c732fa78-318a-484a-8ffa-8ea4cdac2c2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036574 Jul 15 14:12:32.373529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 480/956] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:32.744005 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:32.744856 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:32.751630 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:32.752088 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:32.752890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:32.753329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:32.786307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:32.787547 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:32.787729 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lazy-loading 'fault' on Instance uuid 97a74aad-ee47-42fd-9d8d-889841825a26 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:12:32.835491 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:32.843914 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c3af5753-88e4-475c-8cc6-b21765eebb55 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 200 len: 1303 microversion: 2.1 time: 0.104244 Jul 15 14:12:32.844753 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 477/957] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:32 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:33.864503 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:33.865336 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 97a74aad-ee47-42fd-9d8d-889841825a26] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:33.872172 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:33.872654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:33.873437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:33.873877 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:33.888415 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] HTTP exception thrown: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Request method failure captured: Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 HTTP/1.1 Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XXCiTifOb6o6-mEGYHWPi_3EySXy4Jr8UdXuAeaZprg69JqZ4nj8PBxjCEBuYK7-fsFCwkknVyx56_5EM_5ANdiSGuz84-DhHyshbPOxAi1bt_tRXHBK6x6Uk6EEqUGeRQyGEW4V0e8YSf1srP94wptfCBjOsIG5unNP4nFxZwc-_Q Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 18d5cd47ac9f408385f194b94f17049b Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesActionsTest-218732649 Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:12:33.890097 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18d5cd47ac9f408385f194b94f17049b"}]}] Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesActionsTest-218732649 Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 18d5cd47ac9f408385f194b94f17049b Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesActionsTest-218732649 Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesActionsTest-218732649-project Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 9c0337148d584c14a3dc0fc7ccff766b Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesActionsTest-218732649-project Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. Jul 15 14:12:33.891853 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '97a74aad-ee47-42fd-9d8d-889841825a26'} Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:12:33.893120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. Jul 15 14:12:33.894779 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:33.896879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Returning 404 to user: Instance 97a74aad-ee47-42fd-9d8d-889841825a26 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:12:33.896879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7a9cba0c-8682-4d80-b04d-0083bbbfa55d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26" status: 404 len: 111 microversion: 2.1 time: 0.032626 Jul 15 14:12:33.896879 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 481/958] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:33 2022] GET /compute/v2.1/servers/97a74aad-ee47-42fd-9d8d-889841825a26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:12:33.943530 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-753959161", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "networks": [{"uuid": "9d7449fa-4c1b-47af-88d2-83c6bf0d6c8a"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:34.001523 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] validate_networks() for [('9d7449fa-4c1b-47af-88d2-83c6bf0d6c8a', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:12:34.383043 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:12:34.383476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:12:34.383949 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:12:34.384358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:12:34.384825 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:12:34.394365 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:34.394813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:34.395624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:34.396093 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:34.415164 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Getting quotas for project 18d5cd47ac9f408385f194b94f17049b. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:12:34.419890 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Getting quotas for user 9c0337148d584c14a3dc0fc7ccff766b and project 18d5cd47ac9f408385f194b94f17049b. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:12:34.433659 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:12:34.436068 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:12:34.486060 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-eaad8b98-d3be-4786-89e6-78e1ffa6999b tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546162 Jul 15 14:12:34.486979 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 478/959] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:12:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 14:12:34.501477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-677656c4-e720-41a5-b6f7-978c7775de17 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:34.502542 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-677656c4-e720-41a5-b6f7-978c7775de17 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:34.564203 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-677656c4-e720-41a5-b6f7-978c7775de17 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:34.574153 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-677656c4-e720-41a5-b6f7-978c7775de17 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1213 microversion: 2.1 time: 0.077226 Jul 15 14:12:34.575001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 482/960] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:34 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:35.592228 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:35.592909 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:35.600335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:35.600822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:35.602006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:35.603344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:35.712007 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:35.731131 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-77f2f060-78ba-47e8-84ad-97c5d0127bd7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1273 microversion: 2.1 time: 0.143364 Jul 15 14:12:35.731762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 479/961] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:35 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:36.749827 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:36.750481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:36.757825 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:36.758441 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:36.759343 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:36.759945 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:36.927675 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:36.943446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-544d31d2-21c0-4df6-8958-ff5dea2ae2d9 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.196686 Jul 15 14:12:36.944569 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 483/962] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:36 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:37.117373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-40c9ef79-8bf6-4c70-beba-3394a944556c req-1eb09ea1-7df5-4ab1-96ae-85c2b954691d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992e311c-9915-4352-9785-203f724e5c79", "tag": "3b26a3ab-90ef-4897-9d46-cabacc233493"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:37.128699 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-40c9ef79-8bf6-4c70-beba-3394a944556c req-1eb09ea1-7df5-4ab1-96ae-85c2b954691d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:37.129174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-40c9ef79-8bf6-4c70-beba-3394a944556c req-1eb09ea1-7df5-4ab1-96ae-85c2b954691d service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:37.150385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-40c9ef79-8bf6-4c70-beba-3394a944556c req-1eb09ea1-7df5-4ab1-96ae-85c2b954691d service nova] Creating event network-changed:3b26a3ab-90ef-4897-9d46-cabacc233493 for instance 992e311c-9915-4352-9785-203f724e5c79 on hv-cinder-85000 Jul 15 14:12:37.156530 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-40c9ef79-8bf6-4c70-beba-3394a944556c req-1eb09ea1-7df5-4ab1-96ae-85c2b954691d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043791 Jul 15 14:12:37.157466 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 480/963] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:37.967260 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:37.967820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:37.974487 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:37.974937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:37.975710 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:37.976153 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:38.116968 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:38.124778 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-70d248a1-a51a-4201-8098-73d23637dd7a tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.161402 Jul 15 14:12:38.125369 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 484/964] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:37 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:39.144265 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:39.145023 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:39.152067 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:39.152548 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:39.153342 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:39.153781 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:39.296419 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:39.304208 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-9f840a9b-9b25-424b-9c09-f93c54caa9c7 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.165491 Jul 15 14:12:39.304811 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 481/965] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:39 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:40.320931 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:40.321538 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:40.328372 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:40.328856 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:40.329634 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:40.330075 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:40.464284 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:40.472055 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f5cb8bbc-22ec-474a-9f49-d6c9764ef24e tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.154947 Jul 15 14:12:40.472668 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 485/966] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:40 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:41.489834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:41.490389 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:41.497029 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:41.497482 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:41.498251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:41.498692 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:41.632751 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:41.642225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f88027ca-e3a3-4af5-ad1f-12686ba5c514 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.156392 Jul 15 14:12:41.643371 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 482/967] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:41 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:12:41.756519 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-b784863b-8360-45bb-b4ce-f4e76cf80c74 req-5b486079-682e-44c6-a66b-9963758bfd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992e311c-9915-4352-9785-203f724e5c79", "name": "network-vif-plugged", "status": "completed", "tag": "3b26a3ab-90ef-4897-9d46-cabacc233493"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:41.766723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b784863b-8360-45bb-b4ce-f4e76cf80c74 req-5b486079-682e-44c6-a66b-9963758bfd71 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:41.767176 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-b784863b-8360-45bb-b4ce-f4e76cf80c74 req-5b486079-682e-44c6-a66b-9963758bfd71 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:41.779430 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-b784863b-8360-45bb-b4ce-f4e76cf80c74 req-5b486079-682e-44c6-a66b-9963758bfd71 service nova] Creating event network-vif-plugged:3b26a3ab-90ef-4897-9d46-cabacc233493 for instance 992e311c-9915-4352-9785-203f724e5c79 on hv-cinder-85000 Jul 15 14:12:41.784530 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-b784863b-8360-45bb-b4ce-f4e76cf80c74 req-5b486079-682e-44c6-a66b-9963758bfd71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Jul 15 14:12:41.785355 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 486/968] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:42.661995 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:42.662614 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:42.669923 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:42.670364 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:42.671225 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:42.671662 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:42.811878 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:42.819734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8ad9e3ba-db97-436e-b00c-c5123800b0de tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1313 microversion: 2.1 time: 0.162203 Jul 15 14:12:42.820303 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 483/969] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:42 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:43.837936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:43.838659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:43.845135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:43.845588 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:43.846380 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:43.846824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:43.997575 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:44.005820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-43793112-200d-48a0-9381-b8e33cc65df0 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1498 microversion: 2.1 time: 0.172609 Jul 15 14:12:44.006405 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 487/970] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:43 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:44.453561 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:44.454323 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:44.456562 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:44.457243 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=6 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:44.463836 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:44.464290 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:44.465103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:44.465544 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:44.493016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:12:44.542452 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:44.583732 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-18d69ea7-a403-4fc9-a359-a7dbbd5c99e1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 204 len: 0 microversion: 2.1 time: 0.133226 Jul 15 14:12:44.584448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 484/971] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:12:44 2022] DELETE /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:12:44.593117 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:44.593736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:44.595723 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:12:44.601436 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:44.601893 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:44.602694 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:44.603143 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:44.739693 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:44.747447 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e1597fe3-db1f-4617-8754-796e1c46ebe1 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1504 microversion: 2.1 time: 0.158257 Jul 15 14:12:44.748020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:44 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:45.767378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:45.768080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:45.775385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:45.775834 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:45.776651 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:45.777099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:45.923991 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:45.932085 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-1481f325-e660-44ef-9f39-4329b58dcb5d tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1504 microversion: 2.1 time: 0.168922 Jul 15 14:12:45.932712 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:45 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:46.527823 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-58581ea3-ffc0-4f45-af09-dc04326fe614 req-2935dbcf-ff99-4680-8fd5-1bcaa8a18ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992e311c-9915-4352-9785-203f724e5c79", "name": "network-vif-deleted", "tag": "3b26a3ab-90ef-4897-9d46-cabacc233493"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:12:46.540020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-58581ea3-ffc0-4f45-af09-dc04326fe614 req-2935dbcf-ff99-4680-8fd5-1bcaa8a18ee0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:46.540698 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-58581ea3-ffc0-4f45-af09-dc04326fe614 req-2935dbcf-ff99-4680-8fd5-1bcaa8a18ee0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:46.554781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-58581ea3-ffc0-4f45-af09-dc04326fe614 req-2935dbcf-ff99-4680-8fd5-1bcaa8a18ee0 service nova] Creating event network-vif-deleted:3b26a3ab-90ef-4897-9d46-cabacc233493 for instance 992e311c-9915-4352-9785-203f724e5c79 on hv-cinder-85000 Jul 15 14:12:46.559797 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-58581ea3-ffc0-4f45-af09-dc04326fe614 req-2935dbcf-ff99-4680-8fd5-1bcaa8a18ee0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038877 Jul 15 14:12:46.560445 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 489/974] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:12:46.960070 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:46.960719 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:46.970866 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:46.971762 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:46.973249 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:46.974658 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:47.013733 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:47.014178 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:47.014628 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lazy-loading 'fault' on Instance uuid 992e311c-9915-4352-9785-203f724e5c79 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:12:47.061349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0337148d584c14a3dc0fc7ccff766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cd47ac9f408385f194b94f17049b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:12:47.071362 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c4cf3cc7-5f60-4c35-808c-c4f1a65c2e28 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 200 len: 1303 microversion: 2.1 time: 0.115491 Jul 15 14:12:47.071957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 486/975] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:46 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:12:48.089951 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:12:48.090663 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] [instance: 992e311c-9915-4352-9785-203f724e5c79] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:12:48.097286 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:48.097737 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:48.098529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:12:48.098972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:12:48.113920 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] HTTP exception thrown: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Request method failure captured: Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 HTTP/1.1 Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XXCiTifOb6o6-mEGYHWPi_3EySXy4Jr8UdXuAeaZprg69JqZ4nj8PBxjCEBuYK7-fsFCwkknVyx56_5EM_5ANdiSGuz84-DhHyshbPOxAi1bt_tRXHBK6x6Uk6EEqUGeRQyGEW4V0e8YSf1srP94wptfCBjOsIG5unNP4nFxZwc-_Q Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 18d5cd47ac9f408385f194b94f17049b Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesActionsTest-218732649 Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:12:48.116106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18d5cd47ac9f408385f194b94f17049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18d5cd47ac9f408385f194b94f17049b"}]}] Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesActionsTest-218732649 Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 18d5cd47ac9f408385f194b94f17049b Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesActionsTest-218732649 Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesActionsTest-218732649-project Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 9c0337148d584c14a3dc0fc7ccff766b Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesActionsTest-218732649-project Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. Jul 15 14:12:48.118749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '992e311c-9915-4352-9785-203f724e5c79'} Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:12:48.120731 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. Jul 15 14:12:48.123947 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:12:48.126990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] Returning 404 to user: Instance 992e311c-9915-4352-9785-203f724e5c79 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:12:48.126990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-70819b71-83e6-4383-bcf8-7f30ffebfc56 tempest-VolumesActionsTest-218732649 tempest-VolumesActionsTest-218732649-project] 10.222.0.16 "GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79" status: 404 len: 111 microversion: 2.1 time: 0.032708 Jul 15 14:12:48.126990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 490/976] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:12:48 2022] GET /compute/v2.1/servers/992e311c-9915-4352-9785-203f724e5c79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:13:53.969061 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:13:53.969824 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:13:53.973795 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1078471145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786946882", "security_groups": [{"name": "tempest-secgroup-smoke-245232798"}], "block_device_mapping_v2": [{"uuid": "d8d8a4d9-8c21-446b-a73d-08369b3b7d73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "83416a30-2d17-494b-808c-bdf0235bc309"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:13:54.084116 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] validate_networks() for [('83416a30-2d17-494b-808c-bdf0235bc309', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:13:54.578030 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:13:54.578484 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:13:54.579102 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:13:54.579509 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:13:54.579916 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:13:54.590267 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:54.590717 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:54.591511 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:54.591937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:54.610194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:13:54.614624 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Getting quotas for user 1e956289b0e64cc892d453f427845d71 and project ddbd6e1cb0814523b4e528c14d06cdad. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:13:54.675799 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:13:54.680691 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8d8a4d9-8c21-446b-a73d-08369b3b7d73',volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:13:54.840011 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d45ee137-095e-4fb7-9294-e0554fb966e6 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.872286 Jul 15 14:13:54.841425 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 487/977] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:13:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:13:54.855033 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=40 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:13:54.856251 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=72 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:13:54.863772 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-0b48900f-e93a-4971-a41d-ef85521d582f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:13:54.865515 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-0b48900f-e93a-4971-a41d-ef85521d582f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:13:54.941704 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-0b48900f-e93a-4971-a41d-ef85521d582f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:13:54.949446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-0b48900f-e93a-4971-a41d-ef85521d582f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1094 microversion: 2.1 time: 0.097788 Jul 15 14:13:54.950174 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 491/978] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:13:54 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:13:55.971949 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:13:55.972631 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:13:55.979813 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:55.980640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:55.981631 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:55.982329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:56.058335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:13:56.066307 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8e7d6d5a-259d-4bb6-b4de-c7d78a069ed0 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1210 microversion: 2.1 time: 0.098994 Jul 15 14:13:56.067065 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 488/979] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:13:55 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:13:57.092985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:13:57.094022 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:13:57.103322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:57.103890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:57.104730 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:57.105171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:57.323749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:13:57.335948 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-4afcbbdf-d29e-4638-b4e6-9d4150fc866d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.248444 Jul 15 14:13:57.336560 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 492/980] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:13:57 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:13:57.470975 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-a4ed60a4-14a4-4f23-a293-75e96b621606 req-c4be4643-c7b4-4b5b-99bc-96592824dad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0467893-1553-44ca-929b-ff05f7f889f1", "tag": "cff4b5a1-84a9-42c1-8bb6-bd537dde9040"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:13:57.481228 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-a4ed60a4-14a4-4f23-a293-75e96b621606 req-c4be4643-c7b4-4b5b-99bc-96592824dad8 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:57.482076 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-a4ed60a4-14a4-4f23-a293-75e96b621606 req-c4be4643-c7b4-4b5b-99bc-96592824dad8 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:57.505940 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-a4ed60a4-14a4-4f23-a293-75e96b621606 req-c4be4643-c7b4-4b5b-99bc-96592824dad8 service nova] Creating event network-changed:cff4b5a1-84a9-42c1-8bb6-bd537dde9040 for instance d0467893-1553-44ca-929b-ff05f7f889f1 on hv-cinder-85000 Jul 15 14:13:57.514590 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-a4ed60a4-14a4-4f23-a293-75e96b621606 req-c4be4643-c7b4-4b5b-99bc-96592824dad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046818 Jul 15 14:13:57.517221 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 489/981] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:13:58.361452 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:13:58.362353 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:13:58.370199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:58.370654 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:58.371446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:58.371905 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:58.565441 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:13:58.574246 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ea45cadf-cbce-41d5-bad8-7049998f417d tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.216915 Jul 15 14:13:58.575393 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 493/982] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:13:58 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:13:59.593250 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:13:59.593955 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:13:59.600504 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:59.600955 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:59.601739 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:13:59.602186 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:13:59.746084 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:13:59.754003 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-bf2f545a-4d32-4255-b1b7-6040356211b7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.165500 Jul 15 14:13:59.754713 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 490/983] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:13:59 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:00.772429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:00.773053 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:00.780258 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:00.780888 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:00.781988 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:00.782429 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:00.936984 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:00.945761 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ae9dea2b-cc66-4f0d-86e6-af90cb73768e tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.177596 Jul 15 14:14:00.946348 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 494/984] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:00 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:01.810475 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1275881984", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "networks": [{"uuid": "29c90c1a-657d-462d-a838-b701a7ba42a4"}]}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:01.862780 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.network.neutron [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] validate_networks() for [('29c90c1a-657d-462d-a838-b701a7ba42a4', None, None, None, None, None)] {{(pid=117862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:14:01.963312 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:01.963935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:01.970644 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:01.971089 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:01.971982 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:01.972295 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:02.434760 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:02.442583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-534b3792-4b2f-41e1-a869-d4c97c4e39df tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.483357 Jul 15 14:14:02.443817 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 495/985] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:01 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:02.535848 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Flavor limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:14:02.536363 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Image limits 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:14:02.536993 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Flavor pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:14:02.537447 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Image pref 0:0:0 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:14:02.537903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.virt.hardware [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:14:02.547619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:02.548068 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:02.548910 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:02.549378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:02.567550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Getting quotas for project 3b77053c420a4d1b83cf14e7d8129755. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:14:02.573038 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.quota [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Getting quotas for user 7e5ec9eafc434dbab75eef7288cc1a85 and project 3b77053c420a4d1b83cf14e7d8129755. Resources: {'instances', 'cores', 'ram'} {{(pid=117862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:14:02.586275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Going to run 1 instances... {{(pid=117862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:14:02.588655 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:14:02.640855 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5f20614a-83f7-45a2-81eb-1621822a0943 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834290 Jul 15 14:14:02.641529 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 491/986] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:14:02.652821 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-082ddc45-cd0f-4a47-924a-937145833bb7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:02.653631 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-082ddc45-cd0f-4a47-924a-937145833bb7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:02.715240 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-082ddc45-cd0f-4a47-924a-937145833bb7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:02.723012 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-082ddc45-cd0f-4a47-924a-937145833bb7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1219 microversion: 2.1 time: 0.074515 Jul 15 14:14:02.724995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 496/987] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:02 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:03.460934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:03.462173 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:03.469535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:03.469983 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:03.470775 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:03.471222 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:03.619033 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:03.626840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-35ed9c41-7376-430d-8d86-d9e41c666ddf tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.170349 Jul 15 14:14:03.627410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 492/988] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:03 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:03.748736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:03.749344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:03.757199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:03.757647 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:03.758416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:03.758878 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:03.823751 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:03.831662 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f3c00db4-cfa6-43c2-8aee-b44cb5c3db8c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1271 microversion: 2.1 time: 0.086676 Jul 15 14:14:03.832312 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 497/989] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:03 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:04.644716 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:04.645453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:04.653286 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:04.653748 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:04.654533 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:04.654973 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:04.818776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:04.834457 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-5b266a97-6512-4aaf-ab34-48056d1fd58f tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.192503 Jul 15 14:14:04.835514 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 493/990] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:04 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:04.848671 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:04.849465 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:04.856793 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:04.857308 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:04.858330 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:04.858974 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:04.932080 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:04.939876 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-85951f42-a42c-49c0-bd2b-1974b8237a8e tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1279 microversion: 2.1 time: 0.095174 Jul 15 14:14:04.940623 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 498/991] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:04 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:05.854181 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:05.855551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:05.862372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:05.862835 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:05.863899 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:05.864349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:05.962913 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:05.964344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:05.981093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:05.981093 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:05.982486 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:05.983271 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:06.280367 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:06.298297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:06.301033 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-25a03f0f-b751-421f-83ab-3fa84d54d41a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.450357 Jul 15 14:14:06.302601 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 494/992] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:05 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:06.307008 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-81aa0ca8-0b5a-4da7-86da-8eb5553a976b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.352555 Jul 15 14:14:06.307606 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 499/993] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:05 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:06.466764 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-135c4fff-6248-44a5-b670-f7ff2ba2536b req-f969dfd9-9d4d-43d7-8d16-fdf463153158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643046d9-bf2d-4b4a-b0ae-fed5f4663632", "tag": "cfb24222-73f9-47ab-a9a2-b98b23c0aa82"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:06.487029 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-135c4fff-6248-44a5-b670-f7ff2ba2536b req-f969dfd9-9d4d-43d7-8d16-fdf463153158 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:06.488198 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-135c4fff-6248-44a5-b670-f7ff2ba2536b req-f969dfd9-9d4d-43d7-8d16-fdf463153158 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:06.512802 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-135c4fff-6248-44a5-b670-f7ff2ba2536b req-f969dfd9-9d4d-43d7-8d16-fdf463153158 service nova] Creating event network-changed:cfb24222-73f9-47ab-a9a2-b98b23c0aa82 for instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 on hv-cinder-85000 Jul 15 14:14:06.519666 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-135c4fff-6248-44a5-b670-f7ff2ba2536b req-f969dfd9-9d4d-43d7-8d16-fdf463153158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059658 Jul 15 14:14:06.520417 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 495/994] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:14:07.327406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:07.328072 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:07.331385 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:07.332090 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:07.334940 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:07.335388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:07.336171 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:07.336680 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:07.339103 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:07.339550 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:07.340330 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:07.340803 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:07.537776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:07.546063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f826547e-5556-48cc-ae78-7951a0825acc tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.222644 Jul 15 14:14:07.547074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 500/995] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:07 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:07.550536 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:07.560661 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-cdac3725-5580-42ab-a682-c4960791f1b7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.233835 Jul 15 14:14:07.561244 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 496/996] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:07 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:08.179132 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-ff7e721d-b39c-474c-9dcc-38c7441df088 req-736c0bfd-7476-4b39-b4bb-49d853e4e797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0467893-1553-44ca-929b-ff05f7f889f1", "name": "network-vif-plugged", "status": "completed", "tag": "cff4b5a1-84a9-42c1-8bb6-bd537dde9040"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:08.189071 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ff7e721d-b39c-474c-9dcc-38c7441df088 req-736c0bfd-7476-4b39-b4bb-49d853e4e797 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:08.190114 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-ff7e721d-b39c-474c-9dcc-38c7441df088 req-736c0bfd-7476-4b39-b4bb-49d853e4e797 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:08.204752 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-ff7e721d-b39c-474c-9dcc-38c7441df088 req-736c0bfd-7476-4b39-b4bb-49d853e4e797 service nova] Creating event network-vif-plugged:cff4b5a1-84a9-42c1-8bb6-bd537dde9040 for instance d0467893-1553-44ca-929b-ff05f7f889f1 on hv-cinder-85000 Jul 15 14:14:08.210529 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-ff7e721d-b39c-474c-9dcc-38c7441df088 req-736c0bfd-7476-4b39-b4bb-49d853e4e797 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035942 Jul 15 14:14:08.211543 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 501/997] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:14:08.563335 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:08.564488 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:08.573219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:08.573911 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:08.574881 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:08.575493 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:08.584371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:08.586603 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:08.599622 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:08.600576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:08.602296 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:08.603039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:08.841957 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:08.851595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:08.858380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0033be1b-d24d-4929-b382-8bc4f4988179 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1265 microversion: 2.1 time: 0.299103 Jul 15 14:14:08.859877 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 497/998] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:08 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:08.861191 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-3515e789-36c3-40f0-b733-762ad9efada2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.285996 Jul 15 14:14:08.861769 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 502/999] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:08 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:09.878377 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:09.879050 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:09.886113 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:09.886557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:09.887344 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:09.887513 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:09.887994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:09.888201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:09.895567 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:09.896578 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:09.897576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:09.898031 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:10.128316 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:10.137932 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:10.140206 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-386b815c-029f-4bf1-94b9-6e4a94fb0fcf tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.256455 Jul 15 14:14:10.141054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 503/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:09 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:10.164445 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0f721c33-2446-4d8a-978b-62cb289fb7ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1453 microversion: 2.1 time: 0.289621 Jul 15 14:14:10.165716 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 498/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:09 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:10.182211 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:10.182834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:10.191765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:10.193420 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:10.194523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:10.195126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:10.392257 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:10.404023 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-62e74da2-639c-49f9-a464-62193fb50b06 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1453 microversion: 2.1 time: 0.225409 Jul 15 14:14:10.404939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 504/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:10 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:11.160434 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:11.161922 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:11.169285 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:11.169738 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:11.170544 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:11.171022 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:11.453218 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:11.462996 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-b0a2902d-0958-43bc-927a-17fe64f37261 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.306415 Jul 15 14:14:11.463763 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 499/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:11 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:12.168652 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-1182c275-3b6f-44de-81a3-db15440bebe2 req-d237f19f-42f1-4685-bda2-802741f50270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643046d9-bf2d-4b4a-b0ae-fed5f4663632", "name": "network-vif-plugged", "status": "completed", "tag": "cfb24222-73f9-47ab-a9a2-b98b23c0aa82"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:12.180803 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-1182c275-3b6f-44de-81a3-db15440bebe2 req-d237f19f-42f1-4685-bda2-802741f50270 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:12.181639 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-1182c275-3b6f-44de-81a3-db15440bebe2 req-d237f19f-42f1-4685-bda2-802741f50270 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:12.195329 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-1182c275-3b6f-44de-81a3-db15440bebe2 req-d237f19f-42f1-4685-bda2-802741f50270 service nova] Creating event network-vif-plugged:cfb24222-73f9-47ab-a9a2-b98b23c0aa82 for instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 on hv-cinder-85000 Jul 15 14:14:12.201297 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-1182c275-3b6f-44de-81a3-db15440bebe2 req-d237f19f-42f1-4685-bda2-802741f50270 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038328 Jul 15 14:14:12.202194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 505/1004] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:14:12.481620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:12.482344 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:12.489201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:12.490252 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:12.490992 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:12.491433 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:12.557714 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=4 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:12.580861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=12 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:12.613073 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-96df24c1-e542-4cc3-99e6-d4f2350e14f8 req-7513c2b4-d8fa-4345-a559-66fdf4f72320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0467893-1553-44ca-929b-ff05f7f889f1", "tag": "cff4b5a1-84a9-42c1-8bb6-bd537dde9040"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:12.621984 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-96df24c1-e542-4cc3-99e6-d4f2350e14f8 req-7513c2b4-d8fa-4345-a559-66fdf4f72320 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:12.622430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-96df24c1-e542-4cc3-99e6-d4f2350e14f8 req-7513c2b4-d8fa-4345-a559-66fdf4f72320 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:12.634343 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-96df24c1-e542-4cc3-99e6-d4f2350e14f8 req-7513c2b4-d8fa-4345-a559-66fdf4f72320 service nova] Creating event network-changed:cff4b5a1-84a9-42c1-8bb6-bd537dde9040 for instance d0467893-1553-44ca-929b-ff05f7f889f1 on hv-cinder-85000 Jul 15 14:14:12.635201 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:12.639397 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-96df24c1-e542-4cc3-99e6-d4f2350e14f8 req-7513c2b4-d8fa-4345-a559-66fdf4f72320 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187038 Jul 15 14:14:12.640035 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 500/1005] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:14:12.644425 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-33991c83-44e7-4910-9ac1-34286806f68a tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1319 microversion: 2.1 time: 0.167078 Jul 15 14:14:12.645054 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 506/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:12 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:13.662904 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:13.663540 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:13.669839 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:13.670293 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:13.671083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:13.671501 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:13.800749 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:13.808999 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f30974c6-09e3-49f7-b57e-90e1ac55934f tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1508 microversion: 2.1 time: 0.150954 Jul 15 14:14:13.809559 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 501/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:13 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:28.923310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e97e4964-61a1-4590-9ea4-77b38f5ab5bd", "device": "/dev/sdb"}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:28.924873 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:28.927224 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=4 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:28.928548 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=36 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:28.929187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=76 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:28.935961 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:28.936423 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:28.937194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:28.937626 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:29.173149 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7f90665c-c5ed-4a28-a6f7-237b505e3395 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "POST /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253696 Jul 15 14:14:29.174047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 507/1008] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:14:28 2022] POST /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:14:29.801754 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:14:29.802346 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Fri Jul 15 14:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:14:52.832752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:52.833448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:52.835306 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:52.835986 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=70 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:52.843161 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:52.843639 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:52.844470 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:52.844912 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:52.927934 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lazy-loading 'services' on Instance uuid 643046d9-bf2d-4b4a-b0ae-fed5f4663632 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:14:53.005162 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-825a8e08-df0b-4001-9450-eba50c6e464d tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "DELETE /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632/os-volume_attachments/e97e4964-61a1-4590-9ea4-77b38f5ab5bd" status: 202 len: 0 microversion: 2.1 time: 0.177023 Jul 15 14:14:53.005898 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 502/1009] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:14:52 2022] DELETE /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632/os-volume_attachments/e97e4964-61a1-4590-9ea4-77b38f5ab5bd => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:14:54.129747 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:54.130334 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:54.132820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:54.133600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:14:54.141638 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:54.142087 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:54.142859 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:54.143301 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:54.170363 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:14:54.244637 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7d8e9ee8-c12c-4590-9bcc-fa9a46a898d5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "DELETE /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 204 len: 0 microversion: 2.1 time: 0.118896 Jul 15 14:14:54.245235 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 508/1010] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:14:54 2022] DELETE /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:14:54.254251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:54.254947 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:54.261981 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:54.262426 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:54.263219 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:54.263654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:54.396083 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:54.403547 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7dfe85c7-7bfc-4679-bb76-573018a30ece tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1514 microversion: 2.1 time: 0.153733 Jul 15 14:14:54.404094 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 503/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:54 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:14:55.421576 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:55.422187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:55.428739 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:55.429194 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:55.429972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:55.430406 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:55.560898 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:55.568636 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bd4447c5-de21-4951-8ccc-53db5a0cf4cd tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1514 microversion: 2.1 time: 0.151431 Jul 15 14:14:55.569217 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 509/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:55 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:56.525126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-68da2d77-ea4d-4894-82d7-5196c68ac7ad req-1a9da782-07d7-4852-ad79-32994ed515cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643046d9-bf2d-4b4a-b0ae-fed5f4663632", "name": "network-vif-deleted", "tag": "cfb24222-73f9-47ab-a9a2-b98b23c0aa82"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:14:56.535452 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-68da2d77-ea4d-4894-82d7-5196c68ac7ad req-1a9da782-07d7-4852-ad79-32994ed515cb service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:56.536042 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-68da2d77-ea4d-4894-82d7-5196c68ac7ad req-1a9da782-07d7-4852-ad79-32994ed515cb service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:56.547528 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-68da2d77-ea4d-4894-82d7-5196c68ac7ad req-1a9da782-07d7-4852-ad79-32994ed515cb service nova] Creating event network-vif-deleted:cfb24222-73f9-47ab-a9a2-b98b23c0aa82 for instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 on hv-cinder-85000 Jul 15 14:14:56.552794 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-68da2d77-ea4d-4894-82d7-5196c68ac7ad req-1a9da782-07d7-4852-ad79-32994ed515cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031479 Jul 15 14:14:56.553380 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 504/1013] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:14:56.586187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:56.586801 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:56.593398 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:56.593850 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:56.595167 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:56.595600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:56.630881 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:56.631449 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:56.632119 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lazy-loading 'fault' on Instance uuid 643046d9-bf2d-4b4a-b0ae-fed5f4663632 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:14:56.674506 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:14:56.681922 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-fafabfe7-fe69-4c0a-8790-e007dc5c75a0 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 200 len: 1309 microversion: 2.1 time: 0.099738 Jul 15 14:14:56.682483 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 510/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:56 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:14:57.699972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:14:57.700701 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 643046d9-bf2d-4b4a-b0ae-fed5f4663632] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:14:57.706913 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:57.707358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:57.708147 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:14:57.708620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:14:57.721410 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] HTTP exception thrown: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Request method failure captured: Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 HTTP/1.1 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XYoFKLe8-HECYyG1-Isc4bt7gu-rNw68TqDOCA2N1eimk59LPyCwhD1k5UuGaUyznEdyXnKTj8enAAkNf0BcZnuRTL-mi_0KPq4L3AHBoTmUYasScuA7BTaacrFlVbTOybuP4T7KJHoee731HOogR58tEkUVGV3uXh9Pw5whtvFR8Y Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: 3b77053c420a4d1b83cf14e7d8129755 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:14:57.723010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b77053c420a4d1b83cf14e7d8129755"}]}] Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: 3b77053c420a4d1b83cf14e7d8129755 Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-VolumesSnapshotTestJSON-952065009-project Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 7e5ec9eafc434dbab75eef7288cc1a85 Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-VolumesSnapshotTestJSON-952065009-project Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. Jul 15 14:14:57.724857 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '643046d9-bf2d-4b4a-b0ae-fed5f4663632'} Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:14:57.726098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. Jul 15 14:14:57.727809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:14:57.729429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Returning 404 to user: Instance 643046d9-bf2d-4b4a-b0ae-fed5f4663632 could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:14:57.729429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0263f5af-fd43-468a-b1de-b99679141617 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632" status: 404 len: 111 microversion: 2.1 time: 0.029143 Jul 15 14:14:57.729429 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 505/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:14:57 2022] GET /compute/v2.1/servers/643046d9-bf2d-4b4a-b0ae-fed5f4663632 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:15:07.536360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1300007808", "imageRef": "da81509f-553a-4eb1-bdd5-10cc095c2a1b", "flavorRef": "452", "networks": [{"uuid": "29c90c1a-657d-462d-a838-b701a7ba42a4"}]}} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:07.543418 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:07.544075 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:07.590477 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.network.neutron [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] validate_networks() for [('29c90c1a-657d-462d-a838-b701a7ba42a4', None, None, None, None, None)] {{(pid=117861) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 14:15:08.210916 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Flavor limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 14:15:08.211342 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Image limits 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 14:15:08.211812 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Flavor pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 14:15:08.212248 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Image pref 0:0:0 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 14:15:08.212692 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.virt.hardware [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 14:15:08.222111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:08.222556 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:08.223354 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:08.223794 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:08.240950 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Getting quotas for project 3b77053c420a4d1b83cf14e7d8129755. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 14:15:08.244862 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.quota [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Getting quotas for user 7e5ec9eafc434dbab75eef7288cc1a85 and project 3b77053c420a4d1b83cf14e7d8129755. Resources: {'instances', 'cores', 'ram'} {{(pid=117861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 14:15:08.255806 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Going to run 1 instances... {{(pid=117861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 14:15:08.258063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da81509f-553a-4eb1-bdd5-10cc095c2a1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 14:15:08.302796 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ab5e6272-034c-49bd-b437-ff11344b8726 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770270 Jul 15 14:15:08.303432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 511/1016] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jul 15 14:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 14:15:08.313476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8dff6ef8-49a5-4310-afc6-67cd5619ea10 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:08.314136 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8dff6ef8-49a5-4310-afc6-67cd5619ea10 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:08.316239 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=8 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:08.316926 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:08.371294 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8dff6ef8-49a5-4310-afc6-67cd5619ea10 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:08.378058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8dff6ef8-49a5-4310-afc6-67cd5619ea10 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1219 microversion: 2.1 time: 0.068577 Jul 15 14:15:08.378844 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 506/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:08 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:09.396299 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:09.397107 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:09.403963 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:09.404446 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:09.405226 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:09.405699 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:09.474824 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:09.483199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-cdafe9a9-d6f7-4995-9808-56ad460c72e1 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1277 microversion: 2.1 time: 0.092031 Jul 15 14:15:09.483776 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 512/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:09 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:10.500761 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:10.501992 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:10.509678 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:10.510134 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:10.510907 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:10.511349 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:10.630020 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-2002836a-e779-4e66-af95-9ab858e26797 req-5fe83877-e3f4-4bd8-ac64-b6701e15bbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b5b96d-4b5f-4ba4-a90e-506068e62e82", "tag": "85b89a0f-381a-4737-bf2a-dbdc998b2ed7"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:10.638749 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-2002836a-e779-4e66-af95-9ab858e26797 req-5fe83877-e3f4-4bd8-ac64-b6701e15bbec service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:10.639488 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-2002836a-e779-4e66-af95-9ab858e26797 req-5fe83877-e3f4-4bd8-ac64-b6701e15bbec service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:10.649579 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:10.650571 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-2002836a-e779-4e66-af95-9ab858e26797 req-5fe83877-e3f4-4bd8-ac64-b6701e15bbec service nova] Creating event network-changed:85b89a0f-381a-4737-bf2a-dbdc998b2ed7 for instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 on hv-cinder-85000 Jul 15 14:15:10.656549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-2002836a-e779-4e66-af95-9ab858e26797 req-5fe83877-e3f4-4bd8-ac64-b6701e15bbec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031279 Jul 15 14:15:10.657623 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e1aeafe0-8eb4-4b6c-870e-c38ffea7d560 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.160563 Jul 15 14:15:10.657766 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 513/1019] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:15:10.658680 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 507/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:10 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:11.675864 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:11.676591 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:11.683218 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:11.683666 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:11.684453 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:11.684894 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:11.813396 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:11.821000 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-53549fee-4896-497e-8e3a-bc1a5134c6da tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.149967 Jul 15 14:15:11.821620 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 514/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:11 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:12.837817 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:12.838409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:12.844937 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:12.845390 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:12.846189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:12.847970 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:12.981939 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:12.990329 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-c41fcceb-db98-4c91-8c64-8b31aa4ac466 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.156501 Jul 15 14:15:12.990905 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 508/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:12 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:14.007680 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:14.008223 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:14.014672 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:14.015126 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:14.015889 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:14.016327 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:14.143021 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:14.150549 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-32f82a4d-7d2c-4e9e-8e65-086b1f01cd4b tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.146832 Jul 15 14:15:14.151120 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 515/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:14 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:15.167006 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:15.167646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:15.174409 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:15.174864 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:15.175646 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:15.176082 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:15.312128 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:15.320255 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d5d2bd15-52a1-4886-838e-e7df961e1364 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.157154 Jul 15 14:15:15.320859 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 509/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:15 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:16.337216 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:16.337834 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:16.344310 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:16.344792 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:16.345592 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:16.346034 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:16.481851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:16.490050 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-32436aac-32e1-4fbc-8754-5b598e1037a8 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.156842 Jul 15 14:15:16.490594 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 516/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:16 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:17.078179 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-27bf651b-1397-4129-8aba-263458097a7b req-84880759-be3d-401e-97ed-b0ff65c34eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b5b96d-4b5f-4ba4-a90e-506068e62e82", "name": "network-vif-plugged", "status": "completed", "tag": "85b89a0f-381a-4737-bf2a-dbdc998b2ed7"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:17.087189 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-27bf651b-1397-4129-8aba-263458097a7b req-84880759-be3d-401e-97ed-b0ff65c34eb0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:17.087643 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-27bf651b-1397-4129-8aba-263458097a7b req-84880759-be3d-401e-97ed-b0ff65c34eb0 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:17.103310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-27bf651b-1397-4129-8aba-263458097a7b req-84880759-be3d-401e-97ed-b0ff65c34eb0 service nova] Creating event network-vif-plugged:85b89a0f-381a-4737-bf2a-dbdc998b2ed7 for instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 on hv-cinder-85000 Jul 15 14:15:17.108476 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-27bf651b-1397-4129-8aba-263458097a7b req-84880759-be3d-401e-97ed-b0ff65c34eb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Jul 15 14:15:17.109265 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 510/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:15:17.507805 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:17.508471 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:17.515202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:17.515659 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:17.516447 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:17.516890 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:17.647267 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:17.654957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-1208ba07-939b-4909-92a1-794aa4fdfeef tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.151314 Jul 15 14:15:17.655524 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 517/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:17 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:18.669649 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell0:SELECT=2 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:18.674972 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:18.675736 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:18.682310 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:18.682765 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:18.683535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:18.683978 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:18.822373 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:18.829809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e1be794d-70be-43dd-95c4-fc2b1ed6ee84 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1319 microversion: 2.1 time: 0.161956 Jul 15 14:15:18.830879 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 511/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:18 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:19.846768 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:19.847408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:19.849346 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=2 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:19.850001 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell0:SELECT=6 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:19.856765 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:19.857198 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:19.857955 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:19.858388 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:19.985077 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:19.993489 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-f554f317-33fa-4374-b401-9e4f99d55e16 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1509 microversion: 2.1 time: 0.151105 Jul 15 14:15:19.994062 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 518/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:19 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:20.009569 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4f00f77-0ca4-439e-ad56-846d5dbf698c", "device": "/dev/sdb"}} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:20.011126 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:20.017558 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:20.018010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:20.018776 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:20.019215 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:20.254962 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-10bcda9d-d950-4ba6-8708-39382cfe584c tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "POST /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249031 Jul 15 14:15:20.255543 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 512/1030] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jul 15 14:15:20 2022] POST /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:15:39.550596 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:39.551122 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:39.553179 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:39.553851 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG dbcounter [-] [117861] Writing DB stats nova_cell1:SELECT=40 {{(pid=117861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:39.560740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:39.561183 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:39.561938 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:39.562366 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:39.645589 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.objects.instance [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lazy-loading 'services' on Instance uuid 28b5b96d-4b5f-4ba4-a90e-506068e62e82 {{(pid=117861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:15:39.716252 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-6c832731-080a-4b2f-8238-196ba8943cb3 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82/os-volume_attachments/c4f00f77-0ca4-439e-ad56-846d5dbf698c" status: 202 len: 0 microversion: 2.1 time: 0.169421 Jul 15 14:15:39.716976 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 519/1031] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jul 15 14:15:39 2022] DELETE /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82/os-volume_attachments/c4f00f77-0ca4-439e-ad56-846d5dbf698c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:15:40.836654 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_api:SELECT=16 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:40.837461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG dbcounter [-] [117862] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 14:15:40.841673 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:40.842263 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:40.850581 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:40.850698 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:40.851379 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:40.851822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:40.878626 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:15:40.960333 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-18396db0-cd93-487a-856d-2e779bbd9fec tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 204 len: 0 microversion: 2.1 time: 0.125143 Jul 15 14:15:40.961012 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 513/1032] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:15:40 2022] DELETE /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:15:40.970290 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:40.971002 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:40.978302 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:40.978748 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:40.979600 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:40.980378 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:41.133101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:41.140670 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-bc4c54e8-ef2f-4274-a826-009900cdf886 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1515 microversion: 2.1 time: 0.175025 Jul 15 14:15:41.141231 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 520/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:40 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:42.158358 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:42.159062 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:42.166275 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:42.166734 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:42.167512 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:42.167956 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:42.301144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:42.308636 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-d18d92ce-56ea-433f-a470-a6d13df98ba7 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1515 microversion: 2.1 time: 0.154562 Jul 15 14:15:42.309194 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 514/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:42 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:43.239197 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-5489e883-00b9-4d7e-a94e-9f0efadaaa4d req-a83b000e-3324-40b6-9573-e16891229124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b5b96d-4b5f-4ba4-a90e-506068e62e82", "name": "network-vif-deleted", "tag": "85b89a0f-381a-4737-bf2a-dbdc998b2ed7"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:43.252676 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-5489e883-00b9-4d7e-a94e-9f0efadaaa4d req-a83b000e-3324-40b6-9573-e16891229124 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:43.253995 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-5489e883-00b9-4d7e-a94e-9f0efadaaa4d req-a83b000e-3324-40b6-9573-e16891229124 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:43.268570 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-5489e883-00b9-4d7e-a94e-9f0efadaaa4d req-a83b000e-3324-40b6-9573-e16891229124 service nova] Creating event network-vif-deleted:85b89a0f-381a-4737-bf2a-dbdc998b2ed7 for instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 on hv-cinder-85000 Jul 15 14:15:43.277111 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-5489e883-00b9-4d7e-a94e-9f0efadaaa4d req-a83b000e-3324-40b6-9573-e16891229124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043388 Jul 15 14:15:43.278967 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 521/1035] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:15:43.327372 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:43.328378 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:43.337994 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:43.338640 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:43.339453 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:43.339897 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:43.379430 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:43.380154 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:43.380650 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.objects.instance [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lazy-loading 'fault' on Instance uuid 28b5b96d-4b5f-4ba4-a90e-506068e62e82 {{(pid=117862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 14:15:43.444567 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5ec9eafc434dbab75eef7288cc1a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b77053c420a4d1b83cf14e7d8129755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:43.454677 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-68775386-2ea6-45ad-8dd7-f7be3f42d5f2 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 200 len: 1309 microversion: 2.1 time: 0.131786 Jul 15 14:15:43.455659 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 515/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:43 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:44.093519 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:44.094101 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:44.095237 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-05809327-79de-48a6-9065-182e980a7f2a req-8abf2576-e08b-42fb-88b8-0ad9044d49e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0467893-1553-44ca-929b-ff05f7f889f1", "tag": "cff4b5a1-84a9-42c1-8bb6-bd537dde9040"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:44.101068 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.101513 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.102547 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.102985 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.103724 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-05809327-79de-48a6-9065-182e980a7f2a req-8abf2576-e08b-42fb-88b8-0ad9044d49e3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.104169 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-05809327-79de-48a6-9065-182e980a7f2a req-8abf2576-e08b-42fb-88b8-0ad9044d49e3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.116809 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-05809327-79de-48a6-9065-182e980a7f2a req-8abf2576-e08b-42fb-88b8-0ad9044d49e3 service nova] Creating event network-changed:cff4b5a1-84a9-42c1-8bb6-bd537dde9040 for instance d0467893-1553-44ca-929b-ff05f7f889f1 on hv-cinder-85000 Jul 15 14:15:44.122130 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-05809327-79de-48a6-9065-182e980a7f2a req-8abf2576-e08b-42fb-88b8-0ad9044d49e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030450 Jul 15 14:15:44.123080 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 516/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:15:44.134287 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Going to try to terminate instance {{(pid=117861) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:15:44.219583 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-9cac02a3-c612-4321-81f6-eda3ea4a82e1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 204 len: 0 microversion: 2.1 time: 0.129826 Jul 15 14:15:44.221236 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 522/1038] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:15:44 2022] DELETE /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:15:44.230535 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:44.231274 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:44.238847 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.239396 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.240554 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.241296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.385264 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:44.392842 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-785960aa-4f8a-46c1-b30c-0d4a6b6d7109 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1578 microversion: 2.1 time: 0.166813 Jul 15 14:15:44.393412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 517/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:44 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:15:44.476884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:44.477494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] [instance: 28b5b96d-4b5f-4ba4-a90e-506068e62e82] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:44.484202 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.484782 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.485437 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:44.485866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:44.500403 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] HTTP exception thrown: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Request method failure captured: Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 HTTP/1.1 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XYoFKLe8-HECYyG1-Isc4bt7gu-rNw68TqDOCA2N1eimk59LPyCwhD1k5UuGaUyznEdyXnKTj8enAAkNf0BcZnuRTL-mi_0KPq4L3AHBoTmUYasScuA7BTaacrFlVbTOybuP4T7KJHoee731HOogR58tEkUVGV3uXh9Pw5whtvFR8Y Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: 3b77053c420a4d1b83cf14e7d8129755 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:15:44.502057 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b77053c420a4d1b83cf14e7d8129755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b77053c420a4d1b83cf14e7d8129755"}]}] Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: 3b77053c420a4d1b83cf14e7d8129755 Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-952065009 Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-VolumesSnapshotTestJSON-952065009-project Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 7e5ec9eafc434dbab75eef7288cc1a85 Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-VolumesSnapshotTestJSON-952065009-project Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. Jul 15 14:15:44.503866 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '28b5b96d-4b5f-4ba4-a90e-506068e62e82'} Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:15:44.504861 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. Jul 15 14:15:44.506434 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:44.507678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] Returning 404 to user: Instance 28b5b96d-4b5f-4ba4-a90e-506068e62e82 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:15:44.507678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-aed86944-a238-4038-b01c-e423aab38ae5 tempest-VolumesSnapshotTestJSON-952065009 tempest-VolumesSnapshotTestJSON-952065009-project] 10.222.0.16 "GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82" status: 404 len: 111 microversion: 2.1 time: 0.031503 Jul 15 14:15:44.507678 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 523/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:44 2022] GET /compute/v2.1/servers/28b5b96d-4b5f-4ba4-a90e-506068e62e82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:15:45.410347 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:45.410944 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:45.417613 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:45.418054 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:45.418808 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:45.419238 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:45.549201 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:45.556965 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f184aaef-fdf8-4228-9ac1-2c8f781d33e7 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1578 microversion: 2.1 time: 0.150484 Jul 15 14:15:45.557532 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 518/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:45 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:46.443259 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-04511545-96b6-4a4e-9e98-a2e21e8aa466 req-ca147095-3153-4082-9ada-c8cb2159a573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0467893-1553-44ca-929b-ff05f7f889f1", "name": "network-vif-deleted", "tag": "cff4b5a1-84a9-42c1-8bb6-bd537dde9040"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:46.452350 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-04511545-96b6-4a4e-9e98-a2e21e8aa466 req-ca147095-3153-4082-9ada-c8cb2159a573 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:46.452832 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-04511545-96b6-4a4e-9e98-a2e21e8aa466 req-ca147095-3153-4082-9ada-c8cb2159a573 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:46.464570 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-04511545-96b6-4a4e-9e98-a2e21e8aa466 req-ca147095-3153-4082-9ada-c8cb2159a573 service nova] Creating event network-vif-deleted:cff4b5a1-84a9-42c1-8bb6-bd537dde9040 for instance d0467893-1553-44ca-929b-ff05f7f889f1 on hv-cinder-85000 Jul 15 14:15:46.469370 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-04511545-96b6-4a4e-9e98-a2e21e8aa466 req-ca147095-3153-4082-9ada-c8cb2159a573 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029891 Jul 15 14:15:46.469937 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 524/1042] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 14:15:46.575840 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:46.576481 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:46.583144 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:46.583598 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:46.584381 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:46.584861 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:46.646549 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:46.654056 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-6082491a-d652-4666-8a34-9f8ac6bf7898 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1392 microversion: 2.1 time: 0.083339 Jul 15 14:15:46.654619 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 519/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:46 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1392 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:47.673494 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:47.674107 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:47.680896 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:47.681736 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:47.682656 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:47.683095 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:47.762395 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:47.770800 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-b3ed58b3-9535-4f5d-8b07-e173a39bac1b tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1225 microversion: 2.1 time: 0.102091 Jul 15 14:15:47.771365 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 525/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:47 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 14:15:48.787268 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:48.787792 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:48.794345 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:48.794800 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:48.795568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:48.796005 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:48.857058 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:48.866687 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-8433a8d0-c938-423c-8337-799de12740ae tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 200 len: 1225 microversion: 2.1 time: 0.083413 Jul 15 14:15:48.867251 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 520/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:48 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:49.883740 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:49.884368 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: d0467893-1553-44ca-929b-ff05f7f889f1] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:49.891128 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:49.891589 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:49.892414 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:49.892868 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:49.907481 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] HTTP exception thrown: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Request method failure captured: Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 HTTP/1.1 Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XT95ACeQo2DBxYWmEV6AdXAbZ55vKKzsQE31eAHXQvnLEu6iqYcd1EAkTJOppfM-ehKvYrwBDm8LmvyCEC_sy7wjK69xPv1dMXZHS11jrjCuOccpb8GMVWCNE70lkOxqTMaSDe_yiTgDGuxChClWEjBsc6URhinpOR6aOVuel1B0zk Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:15:49.909169 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddbd6e1cb0814523b4e528c14d06cdad"}]}] Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 1e956289b0e64cc892d453f427845d71 Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. Jul 15 14:15:49.910927 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'd0467893-1553-44ca-929b-ff05f7f889f1'} Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:15:49.911989 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. Jul 15 14:15:49.913628 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:49.915047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Returning 404 to user: Instance d0467893-1553-44ca-929b-ff05f7f889f1 could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:15:49.915047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-03fe22ed-f1d6-4e9a-a2aa-3a9b73b6b6a5 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1" status: 404 len: 111 microversion: 2.1 time: 0.030813 Jul 15 14:15:49.915047 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 526/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:49 2022] GET /compute/v2.1/servers/d0467893-1553-44ca-929b-ff05f7f889f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:15:52.978806 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:52.979315 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:52.982322 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [req-edda5ce2-fdcf-4262-a91b-1b6d353b97f7 req-4ddde6ca-b14c-4230-a1bc-0df411cc6cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ea0b24-ed6f-48ea-a44f-3560c297855d", "tag": "045827b2-1b07-4c35-8cc7-f2329ad46ed0"}]} {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:52.986814 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:52.987850 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:52.988853 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:52.989296 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:53.000243 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-edda5ce2-fdcf-4262-a91b-1b6d353b97f7 req-4ddde6ca-b14c-4230-a1bc-0df411cc6cef service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:53.000707 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [req-edda5ce2-fdcf-4262-a91b-1b6d353b97f7 req-4ddde6ca-b14c-4230-a1bc-0df411cc6cef service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:53.018010 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Going to try to terminate instance {{(pid=117862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 14:15:53.023842 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.compute.server_external_events [req-edda5ce2-fdcf-4262-a91b-1b6d353b97f7 req-4ddde6ca-b14c-4230-a1bc-0df411cc6cef service nova] Creating event network-changed:045827b2-1b07-4c35-8cc7-f2329ad46ed0 for instance f9ea0b24-ed6f-48ea-a44f-3560c297855d on hv-cinder-85000 Jul 15 14:15:53.029360 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [req-edda5ce2-fdcf-4262-a91b-1b6d353b97f7 req-4ddde6ca-b14c-4230-a1bc-0df411cc6cef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050568 Jul 15 14:15:53.029957 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 527/1047] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:15:53.111241 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0ef06252-1a37-48f8-9bc8-ca12297d20bd tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 204 len: 0 microversion: 2.1 time: 0.136149 Jul 15 14:15:53.112517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 521/1048] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:15:52 2022] DELETE /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 14:15:53.122276 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:53.123132 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:53.129934 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:53.130515 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:53.131400 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:53.131935 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:53.272180 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:53.280285 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-e4cdb57c-ce04-45a4-8fdf-e4be79c2d12c tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1576 microversion: 2.1 time: 0.162523 Jul 15 14:15:53.280546 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 528/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:53 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:54.298328 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:54.298936 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:54.305368 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:54.305815 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:54.306568 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:54.307001 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:54.441752 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:54.449361 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-e6f84b7c-89b3-469d-87ec-f34e8ad1d473 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1576 microversion: 2.1 time: 0.155350 Jul 15 14:15:54.449931 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 522/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:54 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:55.467252 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:55.467859 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:55.474924 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:55.475371 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:55.476137 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:55.476598 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:55.605463 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:55.613063 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-ecb01200-9787-4eae-9d61-e3b09d1ab228 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1576 microversion: 2.1 time: 0.149808 Jul 15 14:15:55.613649 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 529/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:55 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:56.630773 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:56.631387 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:56.638007 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:56.638461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:56.639231 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:56.639675 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:56.768300 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.policy [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117862) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:56.776016 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-f25056e0-f348-40e4-9c3a-33bc4f721e10 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1576 microversion: 2.1 time: 0.149194 Jul 15 14:15:56.776606 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 523/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:56 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:57.793976 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:57.794626 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:57.802074 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:57.802527 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:57.803316 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:57.803754 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:57.944091 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.policy [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e956289b0e64cc892d453f427845d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddbd6e1cb0814523b4e528c14d06cdad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117861) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 14:15:57.953980 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-46d4f72e-34bf-4bcf-bda3-eaf7a3cccf51 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 200 len: 1458 microversion: 2.1 time: 0.163824 Jul 15 14:15:57.954568 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 530/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:57 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 1458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 14:15:58.259177 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [req-95c68f72-335f-4ef8-8ba2-484953cebce8 req-f1f0a05f-7dbc-4182-b9ed-0a7f584cc4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ea0b24-ed6f-48ea-a44f-3560c297855d", "name": "network-vif-deleted", "tag": "045827b2-1b07-4c35-8cc7-f2329ad46ed0"}]} {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 14:15:58.267980 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-95c68f72-335f-4ef8-8ba2-484953cebce8 req-f1f0a05f-7dbc-4182-b9ed-0a7f584cc4f3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:58.268487 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [req-95c68f72-335f-4ef8-8ba2-484953cebce8 req-f1f0a05f-7dbc-4182-b9ed-0a7f584cc4f3 service nova] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:58.282448 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.compute.server_external_events [req-95c68f72-335f-4ef8-8ba2-484953cebce8 req-f1f0a05f-7dbc-4182-b9ed-0a7f584cc4f3 service nova] Creating event network-vif-deleted:045827b2-1b07-4c35-8cc7-f2329ad46ed0 for instance f9ea0b24-ed6f-48ea-a44f-3560c297855d on hv-cinder-85000 Jul 15 14:15:58.294076 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [req-95c68f72-335f-4ef8-8ba2-484953cebce8 req-f1f0a05f-7dbc-4182-b9ed-0a7f584cc4f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038473 Jul 15 14:15:58.294822 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 524/1054] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jul 15 14:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 14:15:58.970972 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:58.972187 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: f9ea0b24-ed6f-48ea-a44f-3560c297855d] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:58.979591 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:58.980039 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:58.980847 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:58.981281 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:58.996541 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] HTTP exception thrown: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Request method failure captured: Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d HTTP/1.1 Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XT95ACeQo2DBxYWmEV6AdXAbZ55vKKzsQE31eAHXQvnLEu6iqYcd1EAkTJOppfM-ehKvYrwBDm8LmvyCEC_sy7wjK69xPv1dMXZHS11jrjCuOccpb8GMVWCNE70lkOxqTMaSDe_yiTgDGuxChClWEjBsc6URhinpOR6aOVuel1B0zk Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:15:58.998408 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddbd6e1cb0814523b4e528c14d06cdad"}]}] Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 1e956289b0e64cc892d453f427845d71 Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. Jul 15 14:15:59.000135 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': 'f9ea0b24-ed6f-48ea-a44f-3560c297855d'} Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:15:59.001106 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. Jul 15 14:15:59.002900 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.004341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Returning 404 to user: Instance f9ea0b24-ed6f-48ea-a44f-3560c297855d could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:15:59.004341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-7e6b8c7e-33bb-4018-a0ec-ddd1d4d5aea1 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d" status: 404 len: 111 microversion: 2.1 time: 0.033093 Jul 15 14:15:59.004341 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 531/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:58 2022] GET /compute/v2.1/servers/f9ea0b24-ed6f-48ea-a44f-3560c297855d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:15:59.435903 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:59.436513 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.compute.api [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117862) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:59.443332 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:59.443774 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:59.444557 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:59.444990 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG oslo_concurrency.lockutils [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:59.458738 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.wsgi [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] HTTP exception thrown: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Request method failure captured: Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: request: DELETE /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf HTTP/1.1 Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept: application/json Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Accept-Encoding: identity Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Connection: close Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Length: 0 Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Content-Type: application/json Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Host: 10.222.0.16 Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Openstack-System-Scope: None Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: User-Agent: python-urllib3/1.26.9 Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Auth-Token: gAAAAABi0XT95ACeQo2DBxYWmEV6AdXAbZ55vKKzsQE31eAHXQvnLEu6iqYcd1EAkTJOppfM-ehKvYrwBDm8LmvyCEC_sy7wjK69xPv1dMXZHS11jrjCuOccpb8GMVWCNE70lkOxqTMaSDe_yiTgDGuxChClWEjBsc6URhinpOR6aOVuel1B0zk Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Id: None Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Domain-Name: None Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Identity-Status: Confirmed Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Is-Admin-Project: True Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Id: default Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Domain-Name: Default Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Project-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Role: reader,member Jul 15 14:15:59.460412 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Roles: reader,member Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddbd6e1cb0814523b4e528c14d06cdad"}]}] Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Id: default Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Domain-Name: Default Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Id: 1e956289b0e64cc892d453f427845d71 Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: X-User-Name: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: method: > Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: exception: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.462099 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: action_args: {'id': '8235719c-04b4-4277-8340-90cfffc0c9bf'} Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:15:59.463057 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.464517 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.466098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Returning 404 to user: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. {{(pid=117862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:15:59.466098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-0787d00b-1740-4745-bc24-0ea9ccf711a3 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 404 len: 111 microversion: 2.1 time: 0.030654 Jul 15 14:15:59.466098 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 525/1056] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jul 15 14:15:59 2022] DELETE /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:15:59.470781 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '>' {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:15:59.471936 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.compute.api [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] [instance: 8235719c-04b4-4277-8340-90cfffc0c9bf] Fetching instance by UUID {{(pid=117861) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 14:15:59.478394 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:59.478847 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:59.479618 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 14:15:59.480061 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG oslo_concurrency.lockutils [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Lock "1d9aab78-04cd-4061-be8a-70434796d300" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 14:15:59.494416 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.wsgi [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] HTTP exception thrown: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Request method failure captured: Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: request: GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf HTTP/1.1 Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept: application/json Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Accept-Encoding: identity Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Connection: close Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Length: 0 Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Content-Type: application/json Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Host: 10.222.0.16 Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Openstack-System-Scope: None Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: User-Agent: python-urllib3/1.26.9 Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Auth-Token: gAAAAABi0XT95ACeQo2DBxYWmEV6AdXAbZ55vKKzsQE31eAHXQvnLEu6iqYcd1EAkTJOppfM-ehKvYrwBDm8LmvyCEC_sy7wjK69xPv1dMXZHS11jrjCuOccpb8GMVWCNE70lkOxqTMaSDe_yiTgDGuxChClWEjBsc6URhinpOR6aOVuel1B0zk Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Id: None Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Domain-Name: None Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Identity-Status: Confirmed Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Is-Admin-Project: True Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Id: default Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Domain-Name: Default Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Project-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Role: reader,member Jul 15 14:15:59.495939 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Roles: reader,member Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddbd6e1cb0814523b4e528c14d06cdad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddbd6e1cb0814523b4e528c14d06cdad"}]}] Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Id: ddbd6e1cb0814523b4e528c14d06cdad Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970579683 Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Id: default Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Domain-Name: Default Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Id: 1e956289b0e64cc892d453f427845d71 Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: X-User-Name: tempest-TestVolumeBootPattern-1970579683-project Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: method: > Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: exception: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.497753 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: action_args: {'id': '8235719c-04b4-4277-8340-90cfffc0c9bf'} Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: {{(pid=117861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 14:15:59.498884 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. Jul 15 14:15:59.500432 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: ERROR nova.api.openstack.wsgi Jul 15 14:15:59.502208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: DEBUG nova.api.openstack.wsgi [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Returning 404 to user: Instance 8235719c-04b4-4277-8340-90cfffc0c9bf could not be found. {{(pid=117861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 14:15:59.502208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO nova.api.openstack.requestlog [None req-afdf1ba5-f785-4048-909a-79c642f4f054 tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf" status: 404 len: 111 microversion: 2.1 time: 0.030454 Jul 15 14:15:59.502208 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: [pid: 117861|app: 0|req: 532/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jul 15 14:15:59 2022] GET /compute/v2.1/servers/8235719c-04b4-4277-8340-90cfffc0c9bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 14:16:00.790620 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: DEBUG nova.api.openstack.wsgi [None req-7a88f1d7-b91e-489f-89ac-9a1794d6b22a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] Calling method '.version_select at 0x7fa0c10b9f70>' {{(pid=117862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 14:16:00.813461 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO nova.api.openstack.requestlog [None req-7a88f1d7-b91e-489f-89ac-9a1794d6b22a tempest-TestVolumeBootPattern-1970579683 tempest-TestVolumeBootPattern-1970579683-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-786946882" status: 202 len: 0 microversion: 2.1 time: 0.027232 Jul 15 14:16:00.817172 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: [pid: 117862|app: 0|req: 526/1058] 10.222.0.16 () {58 vars in 1259 bytes} [Fri Jul 15 14:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-786946882 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 14:16:51.189820 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:16:51.190367 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Fri Jul 15 14:16:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:17:52.806720 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:17:52.807523 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Fri Jul 15 14:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:19:28.422577 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:19:28.423182 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Fri Jul 15 14:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:20:11.198667 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:20:11.199199 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Fri Jul 15 14:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:21:09.813551 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:21:09.814174 dv-cinder-850002-1-iscsi devstack@n-api.service[117862]: Fri Jul 15 14:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 14:21:12.814990 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 14:21:12.815595 dv-cinder-850002-1-iscsi devstack@n-api.service[117861]: Fri Jul 15 14:21:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!